Sep 28 17:57:04 devstack cinder-volume[75861]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 17:57:04 devstack cinder-volume[75861]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 17:57:04 devstack cinder-volume[75861]: we strongly recommend against using it for new projects. Sep 28 17:57:04 devstack cinder-volume[75861]: If you are already using Eventlet, we recommend migrating to a different Sep 28 17:57:04 devstack cinder-volume[75861]: framework. For more detail see Sep 28 17:57:04 devstack cinder-volume[75861]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 17:57:04 devstack cinder-volume[75861]: import eventlet # noqa Sep 28 17:57:06 devstack cinder-volume[75861]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75861) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:57:06 devstack cinder-volume[75861]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75861) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:57:06 devstack cinder-volume[75861]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75861) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:57:08 devstack cinder-volume[75861]: INFO dbcounter [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Registered counter for database cinder Sep 28 17:57:08 devstack cinder-volume[75861]: DEBUG oslo_db.sqlalchemy.engines [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75861) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:57:08 devstack cinder-volume[75861]: DEBUG dbcounter [-] [75861] Writer thread running {{(pid=75861) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:57:08 devstack cinder-volume[75861]: INFO cinder.rpc [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 17:57:08 devstack cinder-volume[75861]: INFO cinder.rpc [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 17:57:08 devstack cinder-volume[75861]: DEBUG oslo_db.sqlalchemy.engines [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75861) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:57:08 devstack cinder-volume[75861]: INFO cinder.volume.manager [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Determined volume DB was empty at startup. Sep 28 17:57:08 devstack cinder-volume[75861]: DEBUG cinder.volume.manager [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75861) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 17:57:08 devstack cinder-volume[75861]: INFO cinder.volume.manager [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 17:57:08 devstack cinder-volume[75861]: WARNING stevedore.named [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 17:57:08 devstack cinder-volume[75861]: WARNING castellan.key_manager [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:57:08 devstack cinder-volume[75861]: WARNING cinder.keymgr.conf_key_mgr [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:57:08 devstack cinder-volume[75861]: DEBUG cinder.volume.drivers.lvm [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75861) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 28 17:57:08 devstack cinder-volume[75861]: DEBUG oslo_concurrency.processutils [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75861) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_concurrency.processutils [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] CMD "cinder-rtstool verify" returned: 0 in 0.447s {{(pid=75861) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_db.sqlalchemy.engines [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75861) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:57:09 devstack cinder-volume[75861]: INFO cinder.rpc [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 28 17:57:09 devstack cinder-volume[75861]: INFO cinder.rpc [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 28 17:57:09 devstack cinder-volume[75861]: WARNING stevedore.named [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 17:57:09 devstack cinder-volume[75861]: WARNING castellan.key_manager [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:57:09 devstack cinder-volume[75861]: INFO cinder.volume.manager [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_db.sqlalchemy.engines [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75861) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:57:09 devstack cinder-volume[75861]: INFO oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Starting 1 workers Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Started child 76012 {{(pid=75861) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Full set of CONF: {{(pid=75861) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] ******************************************************************************** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Configuration options gathered from: {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] ================================================================================ {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 17:57:09 devstack cinder-volume[76012]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] allow_availability_zone_fallback = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] allow_compression_on_image_upload = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] allowed_direct_url_schemes = [] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] api_rate_limit = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] auth_strategy = keystone {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] az_cache_duration = 3600 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_availability_zone = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_host = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_name = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_stats_polling_interval = 60 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backup_api_class = cinder.backup.api.API {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backup_name_template = backup-%s {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backup_use_same_host = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backup_use_temp_snapshot = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] chap_password = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] chap_username = {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cinder_internal_tenant_project_id = f1534c683cf047a1a72ed1a6e5cf4523 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cinder_internal_tenant_user_id = 6a0e8f5bb2d94735b647a04fe3c25b3a {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cloned_volume_same_az = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cluster = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] compression_format = gzip {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] compute_api_class = cinder.compute.nova.API {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] config_dir = [] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] config_source = [] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] control_exchange = openstack {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] debug = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] default_availability_zone = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] default_group_type = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] default_volume_type = lvmdriver-1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] disk_geometry = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] driver_client_cert = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] driver_client_cert_key = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] driver_data_namespace = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] driver_ssl_cert_path = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] driver_ssl_cert_verify = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] driver_use_ssl = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] enable_force_upload = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] enable_new_services = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] enable_unsupported_driver = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] enforce_multipath_for_image_xfer = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] filter_function = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] glance_api_insecure = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] glance_api_servers = ['http://192.168.122.56/image'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] glance_api_ssl_compression = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] glance_ca_certificates_file = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] glance_catalog_info = image:glance:publicURL {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] glance_certfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] glance_keyfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] glance_num_retries = 3 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] glance_request_timeout = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] goodness_function = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] graceful_shutdown_timeout = 5 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] group_api_class = cinder.group.api.API {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] host = devstack {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] image_compress_on_upload = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] image_conversion_address_space_limit = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] image_conversion_cpu_limit = 60 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] image_conversion_disable = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] image_introspection_address_space_limit = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] image_introspection_cpu_limit = 60 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] image_upload_use_cinder_backend = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] image_upload_use_internal_tenant = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] image_volume_cache_enabled = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] image_volume_cache_max_count = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] image_volume_cache_max_size_gb = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] init_host_max_objects_retrieval = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] instance_format = [instance: %(uuid)s] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] iscsi_target_flags = {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] iscsi_write_cache = on {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] iser_helper = tgtadm {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] iser_ip_address = 192.168.122.56 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] iser_port = 3260 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] log_color = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] log_config_append = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] log_dir = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] log_file = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[76012]: INFO cinder.volume.manager [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] log_options = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] log_rotate_interval = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] log_rotate_interval_type = days {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] log_rotation_type = none {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] max_age = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] max_logfile_count = 30 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] max_logfile_size_mb = 200 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] max_over_subscription_ratio = 20.0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] message_reap_interval = 86400 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] message_ttl = 2592000 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] migration_create_volume_timeout_secs = 300 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] monkey_patch = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] monkey_patch_modules = [] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] my_ip = 192.168.122.56 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] no_snapshot_gb_quota = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] num_iser_scan_tries = 3 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] num_shell_tries = 3 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] num_volume_device_scan_tries = 3 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] nvmeof_conn_info_version = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] nvmet_ns_id = 10 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] nvmet_port_id = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] osapi_max_limit = 1000 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] osapi_volume_ext_list = [] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] osapi_volume_listen_port = 8776 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] osapi_volume_use_ssl = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] osapi_volume_workers = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] per_volume_size_limit = -1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] periodic_fuzzy_delay = 60 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] periodic_interval = 60 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] public_endpoint = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] publish_errors = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] quota_backup_gigabytes = 1000 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] quota_backups = 10 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] quota_gigabytes = 1000 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] quota_groups = 10 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] quota_snapshots = 10 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] quota_volumes = 10 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] rate_limit_burst = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] rate_limit_except_level = CRITICAL {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] rate_limit_interval = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] reinit_driver_count = 3 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] replication_device = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] report_discard_supported = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] report_interval = 120 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] reservation_clean_interval = 86400 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] reservation_expire = 86400 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] reserved_image_namespaces = [] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] reserved_percentage = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] rpc_response_timeout = 120 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] run_external_periodic_tasks = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] scst_target_driver = iscsi {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] scst_target_iqn_name = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] service_down_time = 720 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] shell_completion = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] snapshot_name_template = snapshot-%s {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] snapshot_same_host = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] split_loggers = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] state_path = /opt/stack/data/cinder {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] storage_availability_zone = nova {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] storage_protocol = iSCSI {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] syslog_log_facility = LOG_USER {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] target_helper = lioadm {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] target_ip_address = 192.168.122.56 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] target_port = 3260 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] target_protocol = iscsi {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] target_secondary_ip_addresses = [] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] trace_flags = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] transport_url = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] until_refresh = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:09 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] use_chap_auth = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] use_default_quota_class = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] use_journal = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] use_json = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] use_multipath_for_image_xfer = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] use_stderr = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] use_syslog = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] verify_glance_signatures = enabled {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] volume_api_class = cinder.volume.api.API {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] volume_backend_name = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] volume_clear = zero {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] volume_clear_ionice = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] volume_clear_size = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] volume_copy_bps_limit = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] volume_dd_blocksize = 1M {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] volume_name_template = volume-%s {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] volume_service_inithost_offload = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] volume_usage_audit_period = month {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] zoning_mode = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_concurrency.disable_process_locking = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.auth_section = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.auth_type = password {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.auth_version = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.cache = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.certfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.include_service_catalog = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.insecure = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.interface = public {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.keyfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.memcache_password = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:09 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.memcache_username = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.region_name = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.service_type = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.56/identity {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.backend = dogpile.cache.null {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.backend_argument = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.backend_expiration_time = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.config_prefix = cache.oslo {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.debug_cache_backend = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.enable_retry_client = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.enable_socket_keepalive = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.enabled = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.expiration_time = 600 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.hashclient_retry_attempts = 2 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.memcache_dead_retry = 300 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.memcache_pool_maxsize = 10 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.memcache_sasl_enabled = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.password = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.proxies = [] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.redis_db = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.redis_server = localhost:6379 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.retry_attempts = 2 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.retry_delay = 0.0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.socket_keepalive_count = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.socket_keepalive_idle = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.socket_keepalive_interval = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.socket_timeout = 1.0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.tls_allowed_ciphers = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.tls_cafile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.tls_certfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.tls_enabled = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.tls_keyfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cache.username = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] coordination.backend_url = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] database.asyncio_connection = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] database.asyncio_slave_connection = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] database.backend = sqlalchemy {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] database.connection = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] database.connection_debug = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] database.connection_parameters = {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] database.connection_recycle_time = 3600 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] database.connection_trace = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] database.db_inc_retry_interval = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack sudo[76020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 28 17:57:09 devstack sudo[76020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] database.db_max_retries = 20 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] database.db_max_retry_interval = 10 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] database.db_retry_interval = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] database.max_overflow = 50 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] database.max_pool_size = 5 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] database.max_retries = 10 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] database.mysql_wsrep_sync_wait = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] database.pool_timeout = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] database.retry_interval = 10 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] database.slave_connection = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] database.sqlite_synchronous = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] database.synchronous_reader = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] database.use_db_reconnect = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_tracing.insecure = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] profiler.connection_string = messaging:// {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] profiler.enabled = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] profiler.es_doc_type = notification {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] profiler.es_scroll_size = 10000 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] profiler.es_scroll_time = 2m {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] profiler.filter_error_trace = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] profiler.hmac_keys = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] profiler.sentinel_service_name = mymaster {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] profiler.socket_timeout = 0.1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] profiler.trace_requests = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] profiler.trace_sqlalchemy = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] profiler_jaeger.process_tags = {} {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] profiler_jaeger.service_name_prefix = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] profiler_otlp.service_name_prefix = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_policy.enforce_new_defaults = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_policy.policy_default_rule = default {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_policy.policy_file = policy.yaml {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] privsep_osbrick.group = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] privsep_osbrick.helper_command = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] privsep_osbrick.user = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cinder_sys_admin.group = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cinder_sys_admin.helper_command = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] cinder_sys_admin.user = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] service_user.auth_section = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] service_user.auth_type = password {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] service_user.cafile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] service_user.certfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] service_user.collect_timing = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] service_user.insecure = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] service_user.keyfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] service_user.send_service_user_token = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] service_user.split_loggers = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] service_user.timeout = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] service_user.tls_ciphers = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] service_user.tls_min_version = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] glance.auth_section = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] glance.auth_type = password {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] glance.certfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] glance.collect_timing = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] glance.insecure = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] glance.keyfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] glance.region_name = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] glance.split_loggers = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] glance.timeout = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] glance.tls_ciphers = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] glance.tls_min_version = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.backend_availability_zone = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.chap_password = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.chap_username = {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.disk_geometry = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.driver_client_cert = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.driver_client_cert_key = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.driver_data_namespace = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.driver_use_ssl = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.extra_capabilities = {} {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.filter_function = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.goodness_function = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.iscsi_target_flags = {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.iscsi_write_cache = on {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.iser_helper = tgtadm {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.iser_ip_address = 192.168.122.56 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.iser_port = 3260 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.lvm_share_target = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.lvm_type = auto {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.num_shell_tries = 3 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.replication_device = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.report_discard_supported = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.reserved_percentage = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.target_helper = tgtadm {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.target_ip_address = 192.168.122.56 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.target_port = 3260 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.target_protocol = iscsi {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.trace_flags = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.unique_fqdn_network = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.use_chap_auth = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.volume_backend_name = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.volume_clear = zero {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.volume_clear_ionice = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.volume_clear_size = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_reports.file_event_handler = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_reports.log_dir = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.backend_host = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.chap_password = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.chap_username = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.disk_geometry = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.driver_client_cert = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.extra_capabilities = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.filter_function = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.goodness_function = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.iser_helper = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.iser_ip_address = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.iser_port = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.lvm_share_target = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.lvm_type = auto {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.num_shell_tries = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.replication_device = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.report_discard_supported = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.reserved_percentage = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.scst_target_driver = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.storage_protocol = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.target_helper = lioadm {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.target_ip_address = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.target_port = 3260 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.trace_flags = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.use_chap_auth = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.volume_clear = zero {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.volume_clear_size = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] lvmdriver-1.volumes_dir = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.ssl = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_notifications.driver = [] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_notifications.retry = -1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] key_manager.fixed_key = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican.barbican_api_version = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican.barbican_endpoint = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican.barbican_endpoint_type = public {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican.barbican_region_name = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican.cafile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican.certfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican.collect_timing = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican.insecure = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican.keyfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican.number_of_retries = 60 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican.retry_delay = 1 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican.send_service_user_token = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican.split_loggers = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican.timeout = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican.tls_ciphers = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican.tls_min_version = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican.verify_ssl = True {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican.verify_ssl_path = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican_service_user.auth_section = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican_service_user.auth_type = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican_service_user.cafile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican_service_user.certfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican_service_user.collect_timing = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican_service_user.insecure = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican_service_user.keyfile = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican_service_user.split_loggers = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican_service_user.timeout = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican_service_user.tls_ciphers = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] barbican_service_user.tls_min_version = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] vault.approle_role_id = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] vault.approle_secret_id = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] vault.auth_method = approle {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] vault.auth_path = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] vault.kv_mountpoint = secret {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] vault.kv_path = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] vault.kv_version = 2 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] vault.namespace = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] vault.root_token_id = **** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] vault.ssl_ca_crt_file = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] vault.timeout = 60.0 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] vault.token_file = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] vault.token_role = None {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] vault.use_ssl = False {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:57:09 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] ******************************************************************************** {{(pid=75861) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 17:57:09 devstack sudo[76020]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:09 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.454s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:09 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:10 devstack sudo[76149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:57:10 devstack sudo[76149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:10 devstack sudo[76149]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:10 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.291s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:10 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:57:10 devstack cinder-volume[76012]: INFO cinder.brick.local_dev.lvm [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 28 17:57:10 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:10 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:10 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:10 devstack sudo[76237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:57:10 devstack sudo[76237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:10 devstack sudo[76237]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:10 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:10 devstack cinder-volume[76012]: DEBUG cinder.brick.local_dev.lvm [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76012) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 28 17:57:10 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:10 devstack sudo[76329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:57:10 devstack sudo[76329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:11 devstack sudo[76329]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:11 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.589s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:11 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:11 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:11 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:11 devstack sudo[76544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:57:11 devstack sudo[76544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:11 devstack sudo[76544]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:11 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.350s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:11 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:11 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:11 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:11 devstack sudo[76628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 28 17:57:11 devstack sudo[76628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:11 devstack sudo[76628]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:11 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.285s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:11 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:11 devstack sudo[76636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:57:11 devstack sudo[76636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:12 devstack sudo[76636]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:12 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.322s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:12 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:12 devstack sudo[76715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:57:12 devstack sudo[76715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:12 devstack sudo[76715]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:12 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:12 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:12 devstack sudo[76724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:57:12 devstack sudo[76724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:12 devstack sudo[76724]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:12 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.337s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:12 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:12 devstack sudo[76807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:57:12 devstack sudo[76807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:13 devstack sudo[76807]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:13 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:13 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:13 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:13 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:13 devstack sudo[76811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:57:13 devstack sudo[76811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:13 devstack sudo[76811]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:13 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:13 devstack cinder-volume[76012]: INFO cinder.volume.drivers.lvm [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 28 17:57:13 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:13 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:13 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:13 devstack sudo[76821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:57:13 devstack sudo[76821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:13 devstack sudo[76821]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:13 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:13 devstack cinder-volume[76012]: DEBUG cinder.volume.drivers.lvm [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Updating volume stats {{(pid=76012) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:57:13 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:13 devstack sudo[76824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:57:13 devstack sudo[76824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:13 devstack sudo[76824]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:13 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:13 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:13 devstack sudo[76827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:57:13 devstack sudo[76827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:14 devstack sudo[76827]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:14 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:14 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:14 devstack sudo[76830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:57:14 devstack sudo[76830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:14 devstack sudo[76830]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:14 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:14 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:14 devstack sudo[76833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:57:14 devstack sudo[76833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:14 devstack sudo[76833]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:14 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:14 devstack cinder-volume[76012]: INFO cinder.volume.driver [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 17:57:14 devstack cinder-volume[76012]: DEBUG cinder.volume.driver [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76012) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 17:57:14 devstack cinder-volume[76012]: DEBUG oslo_db.sqlalchemy.engines [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76012) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:57:14 devstack cinder-volume[76012]: DEBUG dbcounter [-] [76012] Writer thread running {{(pid=76012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:57:14 devstack cinder-volume[76012]: DEBUG cinder.db.api [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Building query based on filter {{(pid=76012) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 17:57:14 devstack cinder-volume[76012]: DEBUG cinder.image.image_utils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76012) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 17:57:14 devstack cinder-volume[76012]: INFO cinder.keymgr.migration [None req-8fe052f5-b623-4a53-a759-64bf62fc10da None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 17:57:14 devstack cinder-volume[76012]: DEBUG cinder.volume.drivers.lvm [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Updating volume stats {{(pid=76012) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:57:14 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:15 devstack sudo[76838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:57:15 devstack sudo[76838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:15 devstack sudo[76838]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:15 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:15 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:15 devstack sudo[76842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:57:15 devstack sudo[76842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:15 devstack sudo[76842]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:15 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.323s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:15 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:15 devstack sudo[76845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:57:15 devstack sudo[76845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:15 devstack sudo[76845]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:15 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:15 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:15 devstack sudo[76848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:57:15 devstack sudo[76848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:16 devstack sudo[76848]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:16 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:16 devstack cinder-volume[76012]: DEBUG cinder.manager [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Notifying Schedulers of capabilities ... {{(pid=76012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:57:16 devstack cinder-volume[76012]: INFO cinder.volume.manager [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Driver initialization completed successfully. Sep 28 17:57:16 devstack cinder-volume[76012]: INFO cinder.manager [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Initiating service 2 cleanup Sep 28 17:57:16 devstack cinder-volume[76012]: INFO cinder.manager [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Service 2 cleanup completed. Sep 28 17:57:16 devstack cinder-volume[76012]: DEBUG cinder.service [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Creating RPC server for service cinder-volume {{(pid=76012) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 17:57:16 devstack cinder-volume[76012]: DEBUG cinder.service [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76012) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 17:57:16 devstack cinder-volume[76012]: INFO cinder.volume.manager [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 28 17:57:16 devstack cinder-volume[76012]: DEBUG cinder.volume.drivers.lvm [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Updating volume stats {{(pid=76012) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:57:16 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:16 devstack sudo[76853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:57:16 devstack sudo[76853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:16 devstack sudo[76853]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:16 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:16 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:16 devstack sudo[76859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:57:16 devstack sudo[76859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:16 devstack sudo[76859]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:16 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:16 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:16 devstack sudo[76862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:57:16 devstack sudo[76862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:17 devstack sudo[76862]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:17 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:17 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:57:17 devstack sudo[76865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:57:17 devstack sudo[76865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:57:17 devstack sudo[76865]: pam_unix(sudo:session): session closed for user root Sep 28 17:57:17 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:57:17 devstack cinder-volume[76012]: INFO cinder.volume.manager [None req-8ddf7ef5-ccea-4934-ae67-67d8d1d3a692 None None] Driver post RPC initialization completed successfully. Sep 28 17:57:19 devstack cinder-volume[75861]: DEBUG dbcounter [-] [75861] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75861) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:57:27 devstack cinder-volume[76012]: DEBUG dbcounter [-] [76012] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:57:27 devstack cinder-volume[76012]: DEBUG dbcounter [-] [76012] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=76012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:58:07 devstack cinder-volume[76012]: DEBUG oslo_service.periodic_task [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] Running periodic task VolumeManager._thread_info {{(pid=76012) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:58:07 devstack cinder-volume[76012]: DEBUG cinder.volume.manager [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] thread count: 6 {{(pid=76012) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:58:07 devstack cinder-volume[76012]: DEBUG cinder.volume.manager [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] thread info: [<_MainThread(MainThread, started 131161550487680)>, , , , , ] {{(pid=76012) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:59:07 devstack cinder-volume[76012]: DEBUG oslo_service.periodic_task [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76012) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:59:07 devstack cinder-volume[76012]: DEBUG cinder.volume.drivers.lvm [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] Updating volume stats {{(pid=76012) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:59:07 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:59:07 devstack sudo[81985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:59:07 devstack sudo[81985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:59:07 devstack sudo[81985]: pam_unix(sudo:session): session closed for user root Sep 28 17:59:07 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:59:07 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:59:07 devstack sudo[82005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:59:07 devstack sudo[82005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:59:08 devstack sudo[82005]: pam_unix(sudo:session): session closed for user root Sep 28 17:59:08 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:59:08 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:59:08 devstack sudo[82008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:59:08 devstack sudo[82008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:59:08 devstack sudo[82008]: pam_unix(sudo:session): session closed for user root Sep 28 17:59:08 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:59:08 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:59:08 devstack sudo[82027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:59:08 devstack sudo[82027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:59:08 devstack sudo[82027]: pam_unix(sudo:session): session closed for user root Sep 28 17:59:08 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:59:08 devstack cinder-volume[76012]: DEBUG cinder.manager [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] Notifying Schedulers of capabilities ... {{(pid=76012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:59:08 devstack cinder-volume[76012]: DEBUG oslo_service.periodic_task [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] Running periodic task VolumeManager._thread_info {{(pid=76012) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:59:08 devstack cinder-volume[76012]: DEBUG cinder.volume.manager [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] thread count: 6 {{(pid=76012) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:59:08 devstack cinder-volume[76012]: DEBUG cinder.volume.manager [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] thread info: [<_MainThread(MainThread, started 131161550487680)>, , , , , ] {{(pid=76012) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:59:27 devstack cinder-volume[76012]: DEBUG dbcounter [-] [76012] Writing DB stats cinder:SELECT=1 {{(pid=76012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:59:27 devstack cinder-volume[76012]: DEBUG dbcounter [-] [76012] Writing DB stats cinder:UPDATE=1 {{(pid=76012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:00:07 devstack cinder-volume[76012]: DEBUG oslo_service.periodic_task [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76012) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:00:07 devstack cinder-volume[76012]: DEBUG cinder.volume.drivers.lvm [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] Updating volume stats {{(pid=76012) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 18:00:07 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:07 devstack sudo[83819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:00:07 devstack sudo[83819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:07 devstack sudo[83819]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:07 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:07 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:07 devstack sudo[83824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:00:07 devstack sudo[83824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:08 devstack sudo[83824]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:08 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:08 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:08 devstack sudo[83845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:00:08 devstack sudo[83845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:08 devstack sudo[83845]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:08 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:08 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:00:08 devstack sudo[83850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:00:08 devstack sudo[83850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:00:08 devstack sudo[83850]: pam_unix(sudo:session): session closed for user root Sep 28 18:00:08 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:00:08 devstack cinder-volume[76012]: DEBUG cinder.manager [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] Notifying Schedulers of capabilities ... {{(pid=76012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:00:08 devstack cinder-volume[76012]: DEBUG oslo_service.periodic_task [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] Running periodic task VolumeManager._thread_info {{(pid=76012) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:00:08 devstack cinder-volume[76012]: DEBUG cinder.volume.manager [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] thread count: 6 {{(pid=76012) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:00:08 devstack cinder-volume[76012]: DEBUG cinder.volume.manager [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] thread info: [<_MainThread(MainThread, started 131161550487680)>, , , , , ] {{(pid=76012) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:01:07 devstack cinder-volume[76012]: DEBUG oslo_service.periodic_task [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76012) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:01:07 devstack cinder-volume[76012]: DEBUG cinder.volume.drivers.lvm [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] Updating volume stats {{(pid=76012) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 18:01:07 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:07 devstack sudo[85147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 18:01:07 devstack sudo[85147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:07 devstack sudo[85147]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:07 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:07 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:07 devstack sudo[85161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:01:07 devstack sudo[85161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:08 devstack sudo[85161]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:08 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:08 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:08 devstack sudo[85164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 18:01:08 devstack sudo[85164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:08 devstack sudo[85164]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:08 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:08 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:08 devstack sudo[85168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 18:01:08 devstack sudo[85168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:08 devstack sudo[85168]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:08 devstack cinder-volume[76012]: DEBUG oslo_concurrency.processutils [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:08 devstack cinder-volume[76012]: DEBUG cinder.manager [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] Notifying Schedulers of capabilities ... {{(pid=76012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:01:08 devstack cinder-volume[76012]: DEBUG oslo_service.periodic_task [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] Running periodic task VolumeManager._thread_info {{(pid=76012) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:01:08 devstack cinder-volume[76012]: DEBUG cinder.volume.manager [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] thread count: 6 {{(pid=76012) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:01:08 devstack cinder-volume[76012]: DEBUG cinder.volume.manager [None req-8acb2d76-e990-4fab-a760-daae8b5f1454 None None] thread info: [<_MainThread(MainThread, started 131161550487680)>, , , , , ] {{(pid=76012) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:01:27 devstack cinder-volume[76012]: DEBUG dbcounter [-] [76012] Writing DB stats cinder:SELECT=1 {{(pid=76012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:01:27 devstack cinder-volume[76012]: DEBUG dbcounter [-] [76012] Writing DB stats cinder:UPDATE=1 {{(pid=76012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:01:46 devstack cinder-volume[75861]: INFO oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Caught SIGTERM, stopping children Sep 28 18:01:46 devstack cinder-volume[75861]: DEBUG oslo_concurrency.lockutils [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Acquiring lock "singleton_lock" {{(pid=75861) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 18:01:46 devstack cinder-volume[75861]: DEBUG oslo_concurrency.lockutils [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Acquired lock "singleton_lock" {{(pid=75861) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 18:01:46 devstack cinder-volume[75861]: DEBUG oslo_concurrency.lockutils [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Releasing lock "singleton_lock" {{(pid=75861) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 18:01:46 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Stop services. {{(pid=75861) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 18:01:46 devstack cinder-volume[75861]: DEBUG oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Killing children. {{(pid=75861) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 18:01:46 devstack cinder-volume[75861]: INFO oslo_service.backend._eventlet.service [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Waiting on 1 children to exit Sep 28 18:01:51 devstack cinder-volume[76012]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 28 18:01:51 devstack cinder-volume[76012]: DEBUG oslo_concurrency.lockutils [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Acquiring lock "singleton_lock" {{(pid=76012) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 18:01:51 devstack cinder-volume[76012]: DEBUG oslo_concurrency.lockutils [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Acquired lock "singleton_lock" {{(pid=76012) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 18:01:51 devstack cinder-volume[76012]: DEBUG oslo_concurrency.lockutils [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Releasing lock "singleton_lock" {{(pid=76012) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 18:01:51 devstack cinder-volume[76012]: WARNING amqp [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 18:01:51 devstack cinder-volume[76012]: WARNING amqp [None req-e50023c5-f8d2-49d2-8e0a-31b6a74dc202 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 18:01:51 devstack cinder-volume[85994]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 18:01:51 devstack cinder-volume[85994]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 18:01:51 devstack cinder-volume[85994]: we strongly recommend against using it for new projects. Sep 28 18:01:51 devstack cinder-volume[85994]: If you are already using Eventlet, we recommend migrating to a different Sep 28 18:01:51 devstack cinder-volume[85994]: framework. For more detail see Sep 28 18:01:51 devstack cinder-volume[85994]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 18:01:51 devstack cinder-volume[85994]: import eventlet # noqa Sep 28 18:01:53 devstack cinder-volume[85994]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85994) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 18:01:53 devstack cinder-volume[85994]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85994) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 18:01:53 devstack cinder-volume[85994]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85994) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 18:01:54 devstack cinder-volume[85994]: INFO dbcounter [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] Registered counter for database cinder Sep 28 18:01:54 devstack cinder-volume[85994]: DEBUG oslo_db.sqlalchemy.engines [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85994) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:01:54 devstack cinder-volume[85994]: DEBUG dbcounter [-] [85994] Writer thread running {{(pid=85994) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 18:01:54 devstack cinder-volume[85994]: INFO cinder.rpc [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 18:01:54 devstack cinder-volume[85994]: INFO cinder.rpc [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 18:01:54 devstack cinder-volume[85994]: DEBUG oslo_db.sqlalchemy.engines [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85994) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:01:55 devstack cinder-volume[85994]: INFO cinder.volume.manager [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] Determined volume DB was empty at startup. Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG cinder.volume.manager [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85994) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 18:01:55 devstack cinder-volume[85994]: INFO cinder.volume.manager [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 18:01:55 devstack cinder-volume[85994]: WARNING stevedore.named [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 18:01:55 devstack cinder-volume[85994]: WARNING castellan.key_manager [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 18:01:55 devstack cinder-volume[85994]: WARNING cinder.keymgr.conf_key_mgr [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 18:01:55 devstack cinder-volume[85994]: INFO cinder.volume.manager [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_db.sqlalchemy.engines [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85994) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:01:55 devstack cinder-volume[85994]: INFO oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] Starting 1 workers Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] Started child 86211 {{(pid=85994) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] Full set of CONF: {{(pid=85994) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] ******************************************************************************** {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] Configuration options gathered from: {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] ================================================================================ {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] allow_availability_zone_fallback = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] allow_compression_on_image_upload = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] allowed_direct_url_schemes = [] {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] api_rate_limit = True {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] auth_strategy = keystone {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[86211]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_availability_zone = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_host = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_name = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_stats_polling_interval = 60 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backup_api_class = cinder.backup.api.API {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backup_name_template = backup-%s {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backup_use_same_host = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backup_use_temp_snapshot = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] chap_password = **** {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] chap_username = {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cinder_internal_tenant_project_id = f1534c683cf047a1a72ed1a6e5cf4523 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cinder_internal_tenant_user_id = 6a0e8f5bb2d94735b647a04fe3c25b3a {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cluster = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] compression_format = gzip {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] compute_api_class = cinder.compute.nova.API {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] config_dir = [] {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] config_source = [] {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] control_exchange = openstack {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] debug = True {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] default_availability_zone = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] default_group_type = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] default_volume_type = QuobyteHD {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] disk_geometry = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] driver_client_cert = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] driver_client_cert_key = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] driver_data_namespace = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] driver_ssl_cert_path = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] driver_ssl_cert_verify = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] driver_use_ssl = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] enable_new_services = True {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] enable_unsupported_driver = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] enabled_backends = ['QuobyteHD'] {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] enforce_multipath_for_image_xfer = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] filter_function = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] glance_api_insecure = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] glance_api_servers = ['http://192.168.122.56/image'] {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] glance_api_ssl_compression = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] glance_ca_certificates_file = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] glance_catalog_info = image:glance:publicURL {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] glance_certfile = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] glance_keyfile = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] glance_num_retries = 3 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] glance_request_timeout = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] goodness_function = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] graceful_shutdown_timeout = 5 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] group_api_class = cinder.group.api.API {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] host = devstack {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] image_compress_on_upload = True {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] image_conversion_address_space_limit = 1 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] image_conversion_cpu_limit = 60 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] image_conversion_disable = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] image_introspection_address_space_limit = 1 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] image_introspection_cpu_limit = 60 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] image_upload_use_cinder_backend = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] image_upload_use_internal_tenant = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] image_volume_cache_enabled = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] image_volume_cache_max_count = 0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] image_volume_cache_max_size_gb = 0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] init_host_max_objects_retrieval = 0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] instance_format = [instance: %(uuid)s] {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] iscsi_target_flags = {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] iscsi_write_cache = on {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] iser_helper = tgtadm {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] iser_ip_address = 192.168.122.56 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] iser_port = 3260 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] log_color = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] log_config_append = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] log_dir = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] log_file = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] log_options = True {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] log_rotate_interval = 1 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] log_rotate_interval_type = days {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] log_rotation_type = none {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] max_age = 0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] max_logfile_count = 30 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] max_logfile_size_mb = 200 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] max_over_subscription_ratio = 20.0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] message_reap_interval = 86400 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] message_ttl = 2592000 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] migration_create_volume_timeout_secs = 300 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[86211]: INFO cinder.volume.manager [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 18:01:55 devstack cinder-volume[86211]: DEBUG cinder.volume.drivers.remotefs [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86211) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] monkey_patch = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] monkey_patch_modules = [] {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] my_ip = 192.168.122.56 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] no_snapshot_gb_quota = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] num_iser_scan_tries = 3 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] num_shell_tries = 3 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] num_volume_device_scan_tries = 3 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] nvmeof_conn_info_version = 1 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] nvmet_ns_id = 10 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] nvmet_port_id = 1 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] osapi_max_limit = 1000 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] osapi_volume_ext_list = [] {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] osapi_volume_listen = 0.0.0.0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] osapi_volume_listen_port = 8776 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] osapi_volume_use_ssl = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] osapi_volume_workers = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] per_volume_size_limit = -1 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] periodic_fuzzy_delay = 60 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] periodic_interval = 60 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] project_id_regex = [0-9a-f\-]+ {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] public_endpoint = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] publish_errors = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] quota_backup_gigabytes = 1000 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] quota_backups = 10 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] quota_gigabytes = 1000 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] quota_groups = 10 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] quota_snapshots = 10 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] quota_volumes = 10 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] rate_limit_burst = 0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] rate_limit_except_level = CRITICAL {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] rate_limit_interval = 0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] reinit_driver_count = 3 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] replication_device = **** {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] report_discard_supported = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] report_interval = 120 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] reservation_clean_interval = 86400 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] reservation_expire = 86400 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] reserved_image_namespaces = [] {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] reserved_percentage = 0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] rpc_response_timeout = 120 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] run_external_periodic_tasks = True {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] scst_target_driver = iscsi {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] scst_target_iqn_name = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] service_down_time = 720 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] shell_completion = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] snapshot_name_template = snapshot-%s {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] split_loggers = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] state_path = /opt/stack/data/cinder {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] storage_availability_zone = nova {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] storage_protocol = iSCSI {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] syslog_log_facility = LOG_USER {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] target_helper = lioadm {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] target_ip_address = 192.168.122.56 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] target_port = 3260 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] target_protocol = iscsi {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] target_secondary_ip_addresses = [] {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] trace_flags = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] transfer_api_class = cinder.transfer.api.API {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] transport_url = **** {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] until_refresh = 0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] use_chap_auth = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] use_default_quota_class = True {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] use_journal = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] use_json = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] use_multipath_for_image_xfer = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] use_stderr = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] use_syslog = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] verify_glance_signatures = enabled {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] volume_api_class = cinder.volume.api.API {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] volume_backend_name = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] volume_clear = zero {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] volume_clear_ionice = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] volume_clear_size = 0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] volume_copy_bps_limit = 0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] volume_dd_blocksize = 1M {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] volume_name_template = volume-%s {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] volume_service_inithost_offload = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] volume_usage_audit_period = month {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] zoning_mode = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:01:55 devstack cinder-volume[86211]: DEBUG cinder.volume.drivers.quobyte [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86211) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 18:01:55 devstack cinder-volume[86211]: WARNING cinder.volume.drivers.quobyte [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 18:01:55 devstack cinder-volume[86211]: WARNING cinder.volume.drivers.quobyte [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 18:01:55 devstack cinder-volume[86211]: DEBUG oslo_concurrency.processutils [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Running cmd (subprocess): mount.quobyte {{(pid=86211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_concurrency.disable_process_locking = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.auth_section = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.auth_type = password {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.auth_version = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.cache = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.certfile = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.delay_auth_decision = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.http_connect_timeout = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.include_service_catalog = True {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.insecure = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.interface = public {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.keyfile = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.memcache_password = **** {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.memcache_username = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.region_name = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.service_token_roles_required = True {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.service_type = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.token_cache_time = 300 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.56/identity {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.backend = dogpile.cache.null {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.backend_argument = **** {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.backend_expiration_time = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.config_prefix = cache.oslo {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.debug_cache_backend = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.enable_retry_client = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.enable_socket_keepalive = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.enabled = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.expiration_time = 600 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.hashclient_retry_attempts = 2 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.memcache_dead_retry = 300 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.memcache_pool_maxsize = 10 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.memcache_sasl_enabled = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.password = **** {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.proxies = [] {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.redis_db = 0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.redis_sentinel_service_name = mymaster {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.redis_server = localhost:6379 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.retry_attempts = 2 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.retry_delay = 0.0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.socket_keepalive_count = 1 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.socket_keepalive_idle = 1 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.socket_keepalive_interval = 1 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.socket_timeout = 1.0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.tls_allowed_ciphers = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.tls_cafile = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.tls_certfile = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.tls_enabled = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.tls_keyfile = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cache.username = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] coordination.backend_url = **** {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] database.asyncio_connection = **** {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] database.asyncio_slave_connection = **** {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] database.backend = sqlalchemy {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] database.connection = **** {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] database.connection_debug = 0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] database.connection_parameters = {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] database.connection_recycle_time = 3600 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] database.connection_trace = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] database.db_inc_retry_interval = True {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] database.db_max_retries = 20 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] database.db_max_retry_interval = 10 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] database.db_retry_interval = 1 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] database.max_overflow = 50 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] database.max_pool_size = 5 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] database.max_retries = 10 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] database.mysql_wsrep_sync_wait = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] database.pool_timeout = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] database.retry_interval = 10 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] database.slave_connection = **** {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] database.sqlite_synchronous = True {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] database.synchronous_reader = True {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] database.use_db_reconnect = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_tracing.insecure = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] profiler.connection_string = messaging:// {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] profiler.enabled = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] profiler.es_doc_type = notification {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] profiler.es_scroll_size = 10000 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] profiler.es_scroll_time = 2m {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] profiler.filter_error_trace = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] profiler.hmac_keys = **** {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] profiler.sentinel_service_name = mymaster {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] profiler.socket_timeout = 0.1 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] profiler.trace_requests = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] profiler.trace_sqlalchemy = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] profiler_jaeger.process_tags = {} {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] profiler_jaeger.service_name_prefix = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] profiler_otlp.service_name_prefix = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_policy.enforce_new_defaults = True {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_policy.policy_default_rule = default {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_policy.policy_file = policy.yaml {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_policy.remote_timeout = 60.0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] privsep_osbrick.group = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] privsep_osbrick.helper_command = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] privsep_osbrick.user = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cinder_sys_admin.group = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cinder_sys_admin.helper_command = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] cinder_sys_admin.user = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] service_user.auth_section = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] service_user.auth_type = password {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] service_user.cafile = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] service_user.certfile = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] service_user.collect_timing = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] service_user.insecure = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] service_user.keyfile = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] service_user.send_service_user_token = True {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] service_user.split_loggers = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] service_user.timeout = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] service_user.tls_ciphers = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] service_user.tls_min_version = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] glance.auth_section = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] glance.auth_type = password {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] glance.certfile = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] glance.collect_timing = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] glance.insecure = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] glance.keyfile = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] glance.region_name = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] glance.split_loggers = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] glance.timeout = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] glance.tls_ciphers = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] glance.tls_min_version = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.backend_availability_zone = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.chap_password = **** {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[86211]: DEBUG oslo_concurrency.processutils [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] CMD "mount.quobyte" returned: 1 in 0.129s {{(pid=86211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.chap_username = {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.disk_geometry = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.driver_client_cert = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.driver_client_cert_key = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.driver_data_namespace = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[86211]: DEBUG oslo_concurrency.lockutils [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.driver_use_ssl = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[86211]: DEBUG oslo_concurrency.lockutils [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.enable_unsupported_driver = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.extra_capabilities = {} {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.filter_function = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.goodness_function = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[86211]: DEBUG cinder.volume.drivers.quobyte [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.iscsi_target_flags = {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[86211]: INFO cinder.volume.drivers.quobyte [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 ... Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.iscsi_write_cache = on {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[86211]: DEBUG oslo_concurrency.processutils [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a -c /etc/quobyte/client-cinder.cfg {{(pid=86211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.iser_helper = tgtadm {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.iser_ip_address = 192.168.122.56 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.iser_port = 3260 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.nas_host = {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.nas_login = admin {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.nas_mount_options = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.nas_password = **** {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.nas_private_key = {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.nas_share_path = {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.nas_ssh_port = 22 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.num_shell_tries = 3 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.nvmet_port_id = 1 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.quobyte_client_cfg = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.quobyte_volume_url = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.replication_device = **** {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.report_discard_supported = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.reserved_percentage = 0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.scst_target_driver = iscsi {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.scst_target_iqn_name = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.storage_protocol = iSCSI {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.target_helper = tgtadm {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.target_ip_address = 192.168.122.56 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.target_port = 3260 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.target_protocol = iscsi {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.trace_flags = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.unique_fqdn_network = True {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.use_chap_auth = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.volume_backend_name = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.volume_clear = zero {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.volume_clear_ionice = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.volume_clear_size = 0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_reports.file_event_handler = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_reports.log_dir = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.backend_availability_zone = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.backend_host = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.chap_password = **** {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.chap_username = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.chiscsi_conf = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.disk_geometry = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.driver_client_cert = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.driver_client_cert_key = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.driver_data_namespace = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.driver_use_ssl = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.extra_capabilities = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.filter_function = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.goodness_function = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.iscsi_target_flags = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.iscsi_write_cache = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.iser_helper = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.iser_ip_address = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.iser_port = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.iser_target_prefix = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.nas_host = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.nas_login = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.nas_mount_options = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.nas_password = **** {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.nas_private_key = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.nas_share_path = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.nas_ssh_port = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.num_shell_tries = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.nvmet_ns_id = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack sudo[86217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a -c /etc/quobyte/client-cinder.cfg Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.nvmet_port_id = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack sudo[86217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.replication_device = **** {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.report_discard_supported = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.reserved_percentage = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.scst_target_driver = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.storage_protocol = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.target_helper = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.target_ip_address = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.target_port = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.target_prefix = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.target_protocol = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.trace_flags = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.unique_fqdn_network = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.use_chap_auth = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.volume_clear = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.volume_clear_ionice = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.volume_clear_size = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] QuobyteHD.volumes_dir = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.ssl = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.ssl_version = {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_notifications.driver = [] {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_notifications.retry = -1 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] oslo_messaging_notifications.transport_url = **** {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] key_manager.fixed_key = **** {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican.barbican_api_version = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican.barbican_endpoint = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican.barbican_endpoint_type = public {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican.barbican_region_name = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican.cafile = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican.certfile = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican.collect_timing = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican.insecure = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican.keyfile = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican.number_of_retries = 60 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican.retry_delay = 1 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican.send_service_user_token = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican.split_loggers = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican.timeout = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican.tls_ciphers = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican.tls_min_version = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican.verify_ssl = True {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican.verify_ssl_path = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican_service_user.auth_section = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican_service_user.auth_type = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican_service_user.cafile = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican_service_user.certfile = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican_service_user.collect_timing = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican_service_user.insecure = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican_service_user.keyfile = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican_service_user.split_loggers = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican_service_user.timeout = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican_service_user.tls_ciphers = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] barbican_service_user.tls_min_version = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] vault.approle_role_id = **** {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] vault.approle_secret_id = **** {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] vault.auth_method = approle {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] vault.auth_path = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] vault.kv_mountpoint = secret {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] vault.kv_path = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] vault.kv_version = 2 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] vault.namespace = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] vault.root_token_id = **** {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] vault.ssl_ca_crt_file = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] vault.timeout = 60.0 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] vault.token_file = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] vault.token_role = None {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] vault.use_ssl = False {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:01:55 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] ******************************************************************************** {{(pid=85994) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 18:01:55 devstack sudo[86217]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:55 devstack cinder-volume[86211]: DEBUG oslo_concurrency.processutils [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.448s {{(pid=86211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:55 devstack cinder-volume[86211]: INFO cinder.volume.drivers.quobyte [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 succeeded Sep 28 18:01:55 devstack cinder-volume[86211]: DEBUG cinder.volume.drivers.quobyte [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:01:55 devstack cinder-volume[86211]: DEBUG oslo_concurrency.lockutils [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.463s {{(pid=86211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:55 devstack cinder-volume[86211]: DEBUG oslo_concurrency.processutils [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:55 devstack sudo[86319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:01:55 devstack sudo[86319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:56 devstack sudo[86319]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:56 devstack cinder-volume[86211]: DEBUG oslo_concurrency.processutils [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.274s {{(pid=86211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:56 devstack cinder-volume[86211]: INFO cinder.volume.driver [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 18:01:56 devstack cinder-volume[86211]: DEBUG cinder.volume.driver [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.122184753418, 'free_capacity_gb': 1775.122184753418, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86211) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 18:01:56 devstack cinder-volume[86211]: DEBUG oslo_db.sqlalchemy.engines [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86211) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:01:56 devstack cinder-volume[86211]: DEBUG dbcounter [-] [86211] Writer thread running {{(pid=86211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 18:01:56 devstack cinder-volume[86211]: DEBUG cinder.db.api [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Building query based on filter {{(pid=86211) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 18:01:56 devstack cinder-volume[86211]: DEBUG cinder.image.image_utils [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86211) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 18:01:56 devstack cinder-volume[86211]: INFO cinder.keymgr.migration [None req-ca73533c-e8e7-4a2e-879f-3e4ec7d5db21 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 18:01:56 devstack cinder-volume[86211]: DEBUG oslo_concurrency.lockutils [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:56 devstack cinder-volume[86211]: DEBUG oslo_concurrency.lockutils [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:56 devstack cinder-volume[86211]: DEBUG cinder.volume.drivers.quobyte [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:01:56 devstack cinder-volume[86211]: DEBUG cinder.volume.drivers.quobyte [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:01:56 devstack cinder-volume[86211]: DEBUG oslo_concurrency.lockutils [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:56 devstack cinder-volume[86211]: DEBUG oslo_concurrency.processutils [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:56 devstack sudo[86322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:01:56 devstack sudo[86322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:56 devstack sudo[86322]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:56 devstack cinder-volume[86211]: DEBUG oslo_concurrency.processutils [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.276s {{(pid=86211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:56 devstack cinder-volume[86211]: DEBUG cinder.manager [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Notifying Schedulers of capabilities ... {{(pid=86211) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:01:56 devstack cinder-volume[86211]: INFO cinder.volume.manager [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Driver initialization completed successfully. Sep 28 18:01:56 devstack cinder-volume[86211]: INFO cinder.manager [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Initiating service 3 cleanup Sep 28 18:01:56 devstack cinder-volume[86211]: INFO cinder.manager [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Service 3 cleanup completed. Sep 28 18:01:56 devstack cinder-volume[86211]: DEBUG cinder.service [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Creating RPC server for service cinder-volume {{(pid=86211) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 18:01:56 devstack cinder-volume[86211]: DEBUG cinder.service [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86211) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 18:01:56 devstack cinder-volume[86211]: INFO cinder.volume.manager [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 18:01:56 devstack cinder-volume[86211]: DEBUG oslo_concurrency.lockutils [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:01:56 devstack cinder-volume[86211]: DEBUG oslo_concurrency.lockutils [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:01:56 devstack cinder-volume[86211]: DEBUG cinder.volume.drivers.quobyte [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86211) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:01:56 devstack cinder-volume[86211]: DEBUG cinder.volume.drivers.quobyte [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86211) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:01:56 devstack cinder-volume[86211]: DEBUG oslo_concurrency.lockutils [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86211) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:01:56 devstack cinder-volume[86211]: DEBUG oslo_concurrency.processutils [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:01:57 devstack sudo[86339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:01:57 devstack sudo[86339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:01:57 devstack sudo[86339]: pam_unix(sudo:session): session closed for user root Sep 28 18:01:57 devstack cinder-volume[86211]: DEBUG oslo_concurrency.processutils [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.419s {{(pid=86211) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:01:57 devstack cinder-volume[86211]: INFO cinder.volume.manager [None req-11212495-0eaf-467f-893f-091493f38ee2 None None] Driver post RPC initialization completed successfully. Sep 28 18:02:01 devstack cinder-volume[85994]: INFO oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] Caught SIGTERM, stopping children Sep 28 18:02:01 devstack cinder-volume[85994]: DEBUG oslo_concurrency.lockutils [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] Acquiring lock "singleton_lock" {{(pid=85994) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 18:02:01 devstack cinder-volume[85994]: DEBUG oslo_concurrency.lockutils [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] Acquired lock "singleton_lock" {{(pid=85994) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 18:02:01 devstack cinder-volume[85994]: DEBUG oslo_concurrency.lockutils [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] Releasing lock "singleton_lock" {{(pid=85994) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 18:02:01 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] Stop services. {{(pid=85994) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 18:02:01 devstack cinder-volume[85994]: DEBUG oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] Killing children. {{(pid=85994) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 18:02:01 devstack cinder-volume[85994]: INFO oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] Waiting on 1 children to exit Sep 28 18:02:05 devstack cinder-volume[86211]: DEBUG oslo_concurrency.lockutils [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] Acquiring lock "singleton_lock" {{(pid=86211) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 18:02:05 devstack cinder-volume[86211]: DEBUG oslo_concurrency.lockutils [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] Acquired lock "singleton_lock" {{(pid=86211) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 18:02:05 devstack cinder-volume[86211]: DEBUG oslo_concurrency.lockutils [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] Releasing lock "singleton_lock" {{(pid=86211) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 18:02:05 devstack cinder-volume[86211]: WARNING amqp [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 18:02:05 devstack cinder-volume[86211]: WARNING amqp [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 18:02:05 devstack cinder-volume[85994]: INFO oslo_service.backend._eventlet.service [None req-337da5ae-4e8a-4e5b-bb03-db821be4b37f None None] Child 86211 exited with status 0 Sep 28 18:02:06 devstack cinder-volume[86664]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 18:02:06 devstack cinder-volume[86664]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 18:02:06 devstack cinder-volume[86664]: we strongly recommend against using it for new projects. Sep 28 18:02:06 devstack cinder-volume[86664]: If you are already using Eventlet, we recommend migrating to a different Sep 28 18:02:06 devstack cinder-volume[86664]: framework. For more detail see Sep 28 18:02:06 devstack cinder-volume[86664]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 18:02:06 devstack cinder-volume[86664]: import eventlet # noqa Sep 28 18:02:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86664) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 18:02:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86664) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 18:02:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86664) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 18:02:09 devstack cinder-volume[86664]: INFO dbcounter [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] Registered counter for database cinder Sep 28 18:02:09 devstack cinder-volume[86664]: DEBUG oslo_db.sqlalchemy.engines [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86664) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:02:09 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writer thread running {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 18:02:09 devstack cinder-volume[86664]: INFO cinder.rpc [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 18:02:09 devstack cinder-volume[86664]: INFO cinder.rpc [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 18:02:09 devstack cinder-volume[86664]: DEBUG oslo_db.sqlalchemy.engines [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86664) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:02:10 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] Determined volume DB was empty at startup. Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86664) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 18:02:10 devstack cinder-volume[86664]: WARNING stevedore.named [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 18:02:10 devstack cinder-volume[86664]: WARNING castellan.key_manager [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 18:02:10 devstack cinder-volume[86664]: WARNING cinder.keymgr.conf_key_mgr [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 18:02:10 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_db.sqlalchemy.engines [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86664) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:02:10 devstack cinder-volume[86664]: INFO oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] Starting 1 workers Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] Started child 86980 {{(pid=86664) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] Full set of CONF: {{(pid=86664) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] ******************************************************************************** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] Configuration options gathered from: {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] ================================================================================ {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 18:02:10 devstack cinder-volume[86980]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] allow_availability_zone_fallback = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] allow_compression_on_image_upload = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] allowed_direct_url_schemes = [] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] api_rate_limit = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] auth_strategy = keystone {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_availability_zone = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_host = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_name = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_stats_polling_interval = 60 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backup_api_class = cinder.backup.api.API {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backup_name_template = backup-%s {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backup_use_same_host = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backup_use_temp_snapshot = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] chap_password = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] chap_username = {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cinder_internal_tenant_project_id = f1534c683cf047a1a72ed1a6e5cf4523 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cinder_internal_tenant_user_id = 6a0e8f5bb2d94735b647a04fe3c25b3a {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cluster = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] compression_format = gzip {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] compute_api_class = cinder.compute.nova.API {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] config_dir = [] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] config_source = [] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] control_exchange = openstack {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] debug = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] default_availability_zone = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] default_group_type = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] default_volume_type = QuobyteHD {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] disk_geometry = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] driver_client_cert = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] driver_client_cert_key = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] driver_data_namespace = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] driver_ssl_cert_path = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] driver_ssl_cert_verify = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] driver_use_ssl = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] enable_new_services = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] enable_unsupported_driver = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] enabled_backends = ['QuobyteHD'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] enforce_multipath_for_image_xfer = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] filter_function = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] glance_api_insecure = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] glance_api_servers = ['http://192.168.122.56/image'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] glance_api_ssl_compression = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] glance_ca_certificates_file = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] glance_catalog_info = image:glance:publicURL {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] glance_certfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] glance_keyfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] glance_num_retries = 3 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] glance_request_timeout = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] goodness_function = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] graceful_shutdown_timeout = 5 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] group_api_class = cinder.group.api.API {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] host = devstack {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] image_compress_on_upload = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] image_conversion_address_space_limit = 1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] image_conversion_cpu_limit = 60 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] image_conversion_disable = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] image_introspection_address_space_limit = 1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] image_introspection_cpu_limit = 60 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] image_upload_use_cinder_backend = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] image_upload_use_internal_tenant = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86980) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] image_volume_cache_enabled = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] image_volume_cache_max_count = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] image_volume_cache_max_size_gb = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] init_host_max_objects_retrieval = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] instance_format = [instance: %(uuid)s] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] iscsi_target_flags = {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] iscsi_write_cache = on {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] iser_helper = tgtadm {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] iser_ip_address = 192.168.122.56 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] iser_port = 3260 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] log_color = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] log_config_append = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] log_dir = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] log_file = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] log_options = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] log_rotate_interval = 1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] log_rotate_interval_type = days {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] log_rotation_type = none {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] max_age = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] max_logfile_count = 30 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] max_logfile_size_mb = 200 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] max_over_subscription_ratio = 20.0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] message_reap_interval = 86400 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] message_ttl = 2592000 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] migration_create_volume_timeout_secs = 300 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] monkey_patch = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] monkey_patch_modules = [] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] my_ip = 192.168.122.56 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] no_snapshot_gb_quota = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] num_iser_scan_tries = 3 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] num_shell_tries = 3 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] num_volume_device_scan_tries = 3 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] nvmeof_conn_info_version = 1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] nvmet_ns_id = 10 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] nvmet_port_id = 1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] osapi_max_limit = 1000 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] osapi_volume_ext_list = [] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] osapi_volume_listen = 0.0.0.0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] osapi_volume_listen_port = 8776 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] osapi_volume_use_ssl = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] osapi_volume_workers = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] per_volume_size_limit = -1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] periodic_fuzzy_delay = 60 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] periodic_interval = 60 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] project_id_regex = [0-9a-f\-]+ {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] public_endpoint = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] publish_errors = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] quota_backup_gigabytes = 1000 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] quota_backups = 10 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] quota_gigabytes = 1000 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] quota_groups = 10 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] quota_snapshots = 10 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] quota_volumes = 10 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] rate_limit_burst = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] rate_limit_except_level = CRITICAL {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] rate_limit_interval = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] reinit_driver_count = 3 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] replication_device = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] report_discard_supported = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] report_interval = 120 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] reservation_clean_interval = 86400 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] reservation_expire = 86400 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] reserved_image_namespaces = [] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] reserved_percentage = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] rpc_response_timeout = 120 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] run_external_periodic_tasks = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] scst_target_driver = iscsi {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] scst_target_iqn_name = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] service_down_time = 720 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] shell_completion = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] snapshot_name_template = snapshot-%s {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] split_loggers = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] state_path = /opt/stack/data/cinder {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] storage_availability_zone = nova {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] storage_protocol = iSCSI {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] syslog_log_facility = LOG_USER {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] target_helper = lioadm {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] target_ip_address = 192.168.122.56 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] target_port = 3260 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] target_protocol = iscsi {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] target_secondary_ip_addresses = [] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] trace_flags = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] transfer_api_class = cinder.transfer.api.API {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] transport_url = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] until_refresh = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] use_chap_auth = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] use_default_quota_class = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] use_journal = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] use_json = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] use_multipath_for_image_xfer = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] use_stderr = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] use_syslog = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] verify_glance_signatures = enabled {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] volume_api_class = cinder.volume.api.API {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] volume_backend_name = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] volume_clear = zero {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] volume_clear_ionice = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] volume_clear_size = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] volume_copy_bps_limit = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] volume_dd_blocksize = 1M {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] volume_name_template = volume-%s {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] volume_service_inithost_offload = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] volume_usage_audit_period = month {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] zoning_mode = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_concurrency.disable_process_locking = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86980) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 18:02:10 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.quobyte [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.auth_section = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.auth_type = password {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.auth_version = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.cache = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.quobyte [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.certfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.delay_auth_decision = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.http_connect_timeout = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Running cmd (subprocess): mount.quobyte {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.include_service_catalog = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.insecure = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.interface = public {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.keyfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.memcache_password = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.memcache_username = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.region_name = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.service_token_roles_required = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.service_type = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.token_cache_time = 300 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.56/identity {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.backend = dogpile.cache.null {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.backend_argument = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.backend_expiration_time = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.config_prefix = cache.oslo {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.debug_cache_backend = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.enable_retry_client = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.enable_socket_keepalive = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.enabled = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.expiration_time = 600 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.hashclient_retry_attempts = 2 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.memcache_dead_retry = 300 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.memcache_pool_maxsize = 10 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.memcache_sasl_enabled = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.password = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.proxies = [] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.redis_db = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.redis_sentinel_service_name = mymaster {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.redis_server = localhost:6379 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.retry_attempts = 2 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.retry_delay = 0.0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.socket_keepalive_count = 1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.socket_keepalive_idle = 1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.socket_keepalive_interval = 1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.socket_timeout = 1.0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.tls_allowed_ciphers = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.tls_cafile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.tls_certfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.tls_enabled = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.tls_keyfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cache.username = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] coordination.backend_url = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] database.asyncio_connection = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] database.asyncio_slave_connection = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] database.backend = sqlalchemy {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] database.connection = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] database.connection_debug = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] database.connection_parameters = {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] database.connection_recycle_time = 3600 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] database.connection_trace = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] database.db_inc_retry_interval = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] database.db_max_retries = 20 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] database.db_max_retry_interval = 10 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] database.db_retry_interval = 1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] database.max_overflow = 50 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] database.max_pool_size = 5 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] database.max_retries = 10 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] database.mysql_wsrep_sync_wait = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] database.pool_timeout = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] database.retry_interval = 10 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] database.slave_connection = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] database.sqlite_synchronous = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] database.synchronous_reader = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] database.use_db_reconnect = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_tracing.insecure = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack quobyte-client[86984]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] profiler.connection_string = messaging:// {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] profiler.enabled = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] profiler.es_doc_type = notification {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] profiler.es_scroll_size = 10000 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] profiler.es_scroll_time = 2m {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] profiler.filter_error_trace = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] profiler.hmac_keys = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack quobyte-client[86984]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] profiler.sentinel_service_name = mymaster {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] profiler.socket_timeout = 0.1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] profiler.trace_requests = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] profiler.trace_sqlalchemy = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] profiler_jaeger.process_tags = {} {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] profiler_jaeger.service_name_prefix = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] profiler_otlp.service_name_prefix = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_policy.enforce_new_defaults = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_policy.policy_default_rule = default {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_policy.policy_file = policy.yaml {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_policy.remote_timeout = 60.0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] privsep_osbrick.group = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] privsep_osbrick.helper_command = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] privsep_osbrick.user = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cinder_sys_admin.group = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cinder_sys_admin.helper_command = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] cinder_sys_admin.user = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] service_user.auth_section = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] service_user.auth_type = password {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] service_user.cafile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] service_user.certfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] service_user.collect_timing = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] service_user.insecure = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] service_user.keyfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] service_user.send_service_user_token = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] service_user.split_loggers = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] service_user.timeout = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] service_user.tls_ciphers = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] service_user.tls_min_version = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] glance.auth_section = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] glance.auth_type = password {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] glance.certfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] glance.collect_timing = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] glance.insecure = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] glance.keyfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] glance.region_name = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] glance.split_loggers = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] glance.timeout = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] glance.tls_ciphers = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] glance.tls_min_version = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.backend_availability_zone = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.chap_password = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.chap_username = {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.disk_geometry = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.driver_client_cert = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.driver_client_cert_key = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.driver_data_namespace = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.driver_use_ssl = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.enable_unsupported_driver = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.extra_capabilities = {} {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.filter_function = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.goodness_function = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.iscsi_target_flags = {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.iscsi_write_cache = on {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.iser_helper = tgtadm {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.iser_ip_address = 192.168.122.56 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.iser_port = 3260 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.nas_host = {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.nas_login = admin {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.nas_mount_options = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.nas_password = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.nas_private_key = {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] CMD "mount.quobyte" returned: 1 in 0.074s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.nas_share_path = {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.nas_ssh_port = 22 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.num_shell_tries = 3 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.nvmet_port_id = 1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.quobyte_client_cfg = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.quobyte_volume_url = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.replication_device = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.report_discard_supported = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.reserved_percentage = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.scst_target_driver = iscsi {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.scst_target_iqn_name = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.storage_protocol = iSCSI {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.target_helper = tgtadm {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.target_ip_address = 192.168.122.56 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.target_port = 3260 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.target_protocol = iscsi {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.trace_flags = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.unique_fqdn_network = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.use_chap_auth = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.volume_backend_name = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.volume_clear = zero {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.volume_clear_ionice = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.volume_clear_size = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_reports.file_event_handler = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_reports.log_dir = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.backend_availability_zone = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.backend_host = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:02:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.chap_password = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.chap_username = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.chiscsi_conf = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.disk_geometry = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.driver_client_cert = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.driver_client_cert_key = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.driver_data_namespace = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.driver_use_ssl = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.extra_capabilities = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.filter_function = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.goodness_function = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.iscsi_target_flags = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.iscsi_write_cache = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.iser_helper = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.iser_ip_address = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.iser_port = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.iser_target_prefix = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.nas_host = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.nas_login = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.nas_mount_options = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.nas_password = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.nas_private_key = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.nas_share_path = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.nas_ssh_port = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.num_shell_tries = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.nvmet_ns_id = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.nvmet_port_id = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.replication_device = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.report_discard_supported = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.reserved_percentage = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.scst_target_driver = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.storage_protocol = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.target_helper = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.target_ip_address = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.target_port = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.target_prefix = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.target_protocol = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.trace_flags = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.unique_fqdn_network = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.use_chap_auth = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.volume_clear = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.volume_clear_ionice = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.volume_clear_size = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] QuobyteHD.volumes_dir = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack sudo[86985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack sudo[86985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.ssl = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.ssl_version = {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_notifications.driver = [] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_notifications.retry = -1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] oslo_messaging_notifications.transport_url = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] key_manager.fixed_key = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican.barbican_api_version = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican.barbican_endpoint = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican.barbican_endpoint_type = public {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican.barbican_region_name = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican.cafile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican.certfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican.collect_timing = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican.insecure = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican.keyfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican.number_of_retries = 60 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican.retry_delay = 1 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican.send_service_user_token = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican.split_loggers = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican.timeout = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican.tls_ciphers = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican.tls_min_version = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican.verify_ssl = True {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican.verify_ssl_path = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican_service_user.auth_section = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican_service_user.auth_type = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican_service_user.cafile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican_service_user.certfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican_service_user.collect_timing = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican_service_user.insecure = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican_service_user.keyfile = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican_service_user.split_loggers = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican_service_user.timeout = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican_service_user.tls_ciphers = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] barbican_service_user.tls_min_version = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] vault.approle_role_id = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] vault.approle_secret_id = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] vault.auth_method = approle {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] vault.auth_path = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] vault.kv_mountpoint = secret {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] vault.kv_path = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] vault.kv_version = 2 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] vault.namespace = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] vault.root_token_id = **** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] vault.ssl_ca_crt_file = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] vault.timeout = 60.0 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] vault.token_file = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] vault.token_role = None {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] vault.use_ssl = False {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 18:02:10 devstack cinder-volume[86664]: DEBUG oslo_service.backend._eventlet.service [None req-c684924b-b18a-4828-9697-21aa4263d9ba None None] ******************************************************************************** {{(pid=86664) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 18:02:10 devstack sudo[86985]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.312s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:10 devstack cinder-volume[86980]: INFO cinder.volume.driver [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Driver hasn't implemented _init_vendor_properties() Sep 28 18:02:10 devstack cinder-volume[86980]: DEBUG cinder.volume.driver [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1236991882324, 'free_capacity_gb': 1775.1236991882324, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86980) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 18:02:10 devstack cinder-volume[86980]: DEBUG oslo_db.sqlalchemy.engines [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86980) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 18:02:10 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writer thread running {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 18:02:10 devstack cinder-volume[86980]: DEBUG cinder.db.api [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Building query based on filter {{(pid=86980) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 18:02:10 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86980) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 18:02:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:10 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:02:10 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:02:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:10 devstack cinder-volume[86980]: INFO cinder.keymgr.migration [None req-c322aa66-0542-4dad-b735-181ce61d7cba None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 18:02:10 devstack sudo[86997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:02:10 devstack sudo[86997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:11 devstack sudo[86997]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.261s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:11 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:02:11 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Driver initialization completed successfully. Sep 28 18:02:11 devstack cinder-volume[86980]: INFO cinder.manager [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Initiating service 3 cleanup Sep 28 18:02:11 devstack cinder-volume[86980]: INFO cinder.manager [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Service 3 cleanup completed. Sep 28 18:02:11 devstack cinder-volume[86980]: DEBUG cinder.service [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Creating RPC server for service cinder-volume {{(pid=86980) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 18:02:11 devstack cinder-volume[86980]: DEBUG cinder.service [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86980) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 18:02:11 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 18:02:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:02:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:02:11 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:02:11 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:02:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:02:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:02:11 devstack sudo[87008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:02:11 devstack sudo[87008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:02:11 devstack sudo[87008]: pam_unix(sudo:session): session closed for user root Sep 28 18:02:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.308s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:02:11 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-f4e53fe2-1953-4bd9-98ab-59b16c4a4a6b None None] Driver post RPC initialization completed successfully. Sep 28 18:02:20 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:02:21 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=2 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:02:21 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:03:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager._thread_info {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:03:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread count: 6 {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:03:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread info: [<_MainThread(MainThread, started 129097393381504)>, , , , , ] {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:03:21 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:03:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Flow 'volume_create_manager' (a906d0e6-59ad-4612-a9c7-e4d0e012898d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b238e17-063f-4b61-bf8b-101f4a403578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b238e17-063f-4b61-bf8b-101f4a403578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-73750463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24645455-f8c8-4d4a-ace1-35ea439e8bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbf4507673a64164befdb5e672508788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:22Z,use_quota=True,user_id='4b7a398fd5d34254a86fef821b15c387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba6de9b-e2ca-4644-a838-7b474476801c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba6de9b-e2ca-4644-a838-7b474476801c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (527b9632-2a98-48ee-bcf8-75e987b80f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (527b9632-2a98-48ee-bcf8-75e987b80f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24645455-f8c8-4d4a-ace1-35ea439e8bac', 'volume_name': 'volume-24645455-f8c8-4d4a-ace1-35ea439e8bac', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2136f56b-639d-439d-8c76-6fbe4b8fb15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2136f56b-639d-439d-8c76-6fbe4b8fb15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c5456b-58bf-4866-a464-7ebce0f3ec2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:22 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Volume 24645455-f8c8-4d4a-ace1-35ea439e8bac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24645455-f8c8-4d4a-ace1-35ea439e8bac', 'volume_size': 1} Sep 28 18:03:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:22 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-73750463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24645455-f8c8-4d4a-ace1-35ea439e8bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbf4507673a64164befdb5e672508788',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:22Z,use_quota=True,user_id='4b7a398fd5d34254a86fef821b15c387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:03:22 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Creating volume 24645455-f8c8-4d4a-ace1-35ea439e8bac {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:03:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:22 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:22 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:22 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:03:22 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:03:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-24645455-f8c8-4d4a-ace1-35ea439e8bac 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:22 devstack sudo[87595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-24645455-f8c8-4d4a-ace1-35ea439e8bac 1073741824 Sep 28 18:03:22 devstack sudo[87595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:23 devstack sudo[87595]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-24645455-f8c8-4d4a-ace1-35ea439e8bac 1073741824" returned: 0 in 1.468s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-24645455-f8c8-4d4a-ace1-35ea439e8bac {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:23 devstack sudo[87929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-24645455-f8c8-4d4a-ace1-35ea439e8bac Sep 28 18:03:23 devstack sudo[87929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:24 devstack sudo[87929]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-24645455-f8c8-4d4a-ace1-35ea439e8bac" returned: 0 in 0.451s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:24 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] <== create_volume: return (2040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:03:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.045s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c5456b-58bf-4866-a464-7ebce0f3ec2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24645455-f8c8-4d4a-ace1-35ea439e8bac', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8152fc-3e93-4832-a604-5fa66750d6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:24 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Volume volume-24645455-f8c8-4d4a-ace1-35ea439e8bac (24645455-f8c8-4d4a-ace1-35ea439e8bac): created successfully Sep 28 18:03:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8152fc-3e93-4832-a604-5fa66750d6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Flow 'volume_create_manager' (a906d0e6-59ad-4612-a9c7-e4d0e012898d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:24 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-aa958855-e31e-4c16-97af-bc4cb758fed4 tempest-DeleteServersTestJSON-837664681 None] Created volume successfully. Sep 28 18:03:30 devstack cinder-volume[86980]: WARNING py.warnings [req-4250733f-d0b8-4e0e-9e63-70503e04ca2c req-9a6c57b8-c97d-4271-afb8-36e2f63df4c7 tempest-DeleteServersTestJSON-837664681 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 28 18:03:30 devstack cinder-volume[86980]: .first() Sep 28 18:03:30 devstack cinder-volume[86980]: Sep 28 18:03:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-4250733f-d0b8-4e0e-9e63-70503e04ca2c req-9a6c57b8-c97d-4271-afb8-36e2f63df4c7 tempest-DeleteServersTestJSON-837664681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-4250733f-d0b8-4e0e-9e63-70503e04ca2c req-9a6c57b8-c97d-4271-afb8-36e2f63df4c7 tempest-DeleteServersTestJSON-837664681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-4250733f-d0b8-4e0e-9e63-70503e04ca2c req-9a6c57b8-c97d-4271-afb8-36e2f63df4c7 tempest-DeleteServersTestJSON-837664681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:30 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-4250733f-d0b8-4e0e-9e63-70503e04ca2c req-9a6c57b8-c97d-4271-afb8-36e2f63df4c7 tempest-DeleteServersTestJSON-837664681 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729', 'name': 'volume-24645455-f8c8-4d4a-ace1-35ea439e8bac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4eaa4483-8843-4685-829f-cc5b620668b2', 'enforce_multipath': True} {{(pid=86980) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:03:31 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-4250733f-d0b8-4e0e-9e63-70503e04ca2c req-9a6c57b8-c97d-4271-afb8-36e2f63df4c7 tempest-DeleteServersTestJSON-837664681 None] attachment_update completed successfully. Sep 28 18:03:37 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-20ad4052-2bf1-4113-a833-e6668d6bd71d req-1a97ed73-3955-41f1-80db-0261c4ee927a tempest-DeleteServersTestJSON-837664681 None] Terminate volume connection completed successfully. Sep 28 18:03:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-20ad4052-2bf1-4113-a833-e6668d6bd71d req-1a97ed73-3955-41f1-80db-0261c4ee927a tempest-DeleteServersTestJSON-837664681 None] Deleting attachment 4eaa4483-8843-4685-829f-cc5b620668b2. {{(pid=86980) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:03:38 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:03:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Flow 'volume_create_manager' (33a5af80-3914-47e8-9ab7-c67b6a130fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (013a8442-2580-4c80-9db1-7e54c0ec399f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (013a8442-2580-4c80-9db1-7e54c0ec399f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-91662502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd98054-50b6-4ffe-8582-bf50de77e9ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a6ece283e664f6da3b6d184860a1aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:38Z,use_quota=True,user_id='7bd16de6b1f442179c5d94e3a43cbe6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d64e6639-0644-4cae-996b-7e13fcb484af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d64e6639-0644-4cae-996b-7e13fcb484af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf2fe3e-8f14-40d9-8a57-371244e533dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf2fe3e-8f14-40d9-8a57-371244e533dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cd98054-50b6-4ffe-8582-bf50de77e9ea', 'volume_name': 'volume-5cd98054-50b6-4ffe-8582-bf50de77e9ea', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644ad001-77c2-4dc9-ac0b-e40482085293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644ad001-77c2-4dc9-ac0b-e40482085293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db0a233-4e7d-4895-bf70-9a2abf6359fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:38 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Volume 5cd98054-50b6-4ffe-8582-bf50de77e9ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cd98054-50b6-4ffe-8582-bf50de77e9ea', 'volume_size': 1} Sep 28 18:03:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-91662502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd98054-50b6-4ffe-8582-bf50de77e9ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a6ece283e664f6da3b6d184860a1aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:38Z,use_quota=True,user_id='7bd16de6b1f442179c5d94e3a43cbe6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:03:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Creating volume 5cd98054-50b6-4ffe-8582-bf50de77e9ea {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:03:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:03:38 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:03:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5cd98054-50b6-4ffe-8582-bf50de77e9ea 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:38 devstack sudo[88563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5cd98054-50b6-4ffe-8582-bf50de77e9ea 1073741824 Sep 28 18:03:38 devstack sudo[88563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:39 devstack sudo[88563]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5cd98054-50b6-4ffe-8582-bf50de77e9ea 1073741824" returned: 0 in 0.739s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5cd98054-50b6-4ffe-8582-bf50de77e9ea {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:39 devstack sudo[88570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5cd98054-50b6-4ffe-8582-bf50de77e9ea Sep 28 18:03:39 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:39 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5cd98054-50b6-4ffe-8582-bf50de77e9ea" returned: 0 in 0.262s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:03:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db0a233-4e7d-4895-bf70-9a2abf6359fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cd98054-50b6-4ffe-8582-bf50de77e9ea', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41797716-cc97-4419-83e5-7b31ec327c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:39 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Volume volume-5cd98054-50b6-4ffe-8582-bf50de77e9ea (5cd98054-50b6-4ffe-8582-bf50de77e9ea): created successfully Sep 28 18:03:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41797716-cc97-4419-83e5-7b31ec327c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Flow 'volume_create_manager' (33a5af80-3914-47e8-9ab7-c67b6a130fee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:39 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-ceb977aa-675d-4d2a-ae5e-805a1eea8d70 tempest-VolumesAdminNegativeTest-1986653264 None] Created volume successfully. Sep 28 18:03:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d666b1e0-ad48-4d79-bf18-2d09f720b697 tempest-DeleteServersTestJSON-837664681 None] Acquiring lock "cinder-24645455-f8c8-4d4a-ace1-35ea439e8bac-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d666b1e0-ad48-4d79-bf18-2d09f720b697 tempest-DeleteServersTestJSON-837664681 None] Lock "cinder-24645455-f8c8-4d4a-ace1-35ea439e8bac-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-596728c2-e812-4c55-a03d-61c97960182f tempest-VolumesAdminNegativeTest-1986653264 None] Acquiring lock "cinder-5cd98054-50b6-4ffe-8582-bf50de77e9ea-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d666b1e0-ad48-4d79-bf18-2d09f720b697 tempest-DeleteServersTestJSON-837664681 None] Acquiring lock "cinder-quobyte-24645455-f8c8-4d4a-ace1-35ea439e8bac" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d666b1e0-ad48-4d79-bf18-2d09f720b697 tempest-DeleteServersTestJSON-837664681 None] Lock "cinder-quobyte-24645455-f8c8-4d4a-ace1-35ea439e8bac" acquired by "delete_volume" :: waited 0.041s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:40 devstack cinder-volume[86980]: INFO oslo.privsep.daemon [None req-d666b1e0-ad48-4d79-bf18-2d09f720b697 tempest-DeleteServersTestJSON-837664681 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpbtj1ceb4/privsep.sock'] Sep 28 18:03:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-596728c2-e812-4c55-a03d-61c97960182f tempest-VolumesAdminNegativeTest-1986653264 None] Lock "cinder-5cd98054-50b6-4ffe-8582-bf50de77e9ea-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:40 devstack sudo[88612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpbtj1ceb4/privsep.sock Sep 28 18:03:40 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-596728c2-e812-4c55-a03d-61c97960182f tempest-VolumesAdminNegativeTest-1986653264 None] Acquiring lock "cinder-quobyte-5cd98054-50b6-4ffe-8582-bf50de77e9ea" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:03:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-596728c2-e812-4c55-a03d-61c97960182f tempest-VolumesAdminNegativeTest-1986653264 None] Lock "cinder-quobyte-5cd98054-50b6-4ffe-8582-bf50de77e9ea" acquired by "delete_volume" :: waited 0.033s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:03:41 devstack cinder-volume[86980]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 28 18:03:41 devstack cinder-volume[86980]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 18:03:41 devstack cinder-volume[86980]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 28 18:03:41 devstack cinder-volume[86980]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 18:03:41 devstack cinder-volume[86980]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 28 18:03:41 devstack cinder-volume[86980]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 28 18:03:41 devstack cinder-volume[86980]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 18:03:41 devstack cinder-volume[86980]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 18:03:41 devstack cinder-volume[86980]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 28 18:03:41 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:41 devstack cinder-volume[86980]: INFO oslo.privsep.daemon [None req-d666b1e0-ad48-4d79-bf18-2d09f720b697 tempest-DeleteServersTestJSON-837664681 None] Spawned new privsep daemon via rootwrap Sep 28 18:03:41 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [None req-d666b1e0-ad48-4d79-bf18-2d09f720b697 tempest-DeleteServersTestJSON-837664681 None] Accepted privsep connection to /tmp/tmpbtj1ceb4/privsep.sock {{(pid=86980) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 28 18:03:41 devstack cinder-volume[86980]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 28 18:03:41 devstack cinder-volume[86980]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 28 18:03:41 devstack cinder-volume[86980]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 28 18:03:41 devstack cinder-volume[86980]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88615 Sep 28 18:03:41 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f7fe3d-9061-4f69-9584-d0874f240381]: (2,) {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:03:41 devstack cinder-volume[86980]: WARNING oslo_privsep.priv_context [None req-596728c2-e812-4c55-a03d-61c97960182f tempest-VolumesAdminNegativeTest-1986653264 None] privsep daemon already running Sep 28 18:03:41 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9be81cb-d447-48ec-bc47-2d8e9c230d6e]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:03:41 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[90125382-19a5-4f30-9735-5577f88cee7e]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:03:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d666b1e0-ad48-4d79-bf18-2d09f720b697 tempest-DeleteServersTestJSON-837664681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-24645455-f8c8-4d4a-ace1-35ea439e8bac {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-596728c2-e812-4c55-a03d-61c97960182f tempest-VolumesAdminNegativeTest-1986653264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5cd98054-50b6-4ffe-8582-bf50de77e9ea {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:42 devstack sudo[88619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-24645455-f8c8-4d4a-ace1-35ea439e8bac Sep 28 18:03:42 devstack sudo[88619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:42 devstack sudo[88620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5cd98054-50b6-4ffe-8582-bf50de77e9ea Sep 28 18:03:42 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:42 devstack sudo[88619]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d666b1e0-ad48-4d79-bf18-2d09f720b697 tempest-DeleteServersTestJSON-837664681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-24645455-f8c8-4d4a-ace1-35ea439e8bac" returned: 0 in 0.482s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d666b1e0-ad48-4d79-bf18-2d09f720b697 tempest-DeleteServersTestJSON-837664681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-24645455-f8c8-4d4a-ace1-35ea439e8bac {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:42 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:42 devstack sudo[88630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-24645455-f8c8-4d4a-ace1-35ea439e8bac Sep 28 18:03:42 devstack sudo[88630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-596728c2-e812-4c55-a03d-61c97960182f tempest-VolumesAdminNegativeTest-1986653264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5cd98054-50b6-4ffe-8582-bf50de77e9ea" returned: 0 in 0.511s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-596728c2-e812-4c55-a03d-61c97960182f tempest-VolumesAdminNegativeTest-1986653264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5cd98054-50b6-4ffe-8582-bf50de77e9ea {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:42 devstack sudo[88632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5cd98054-50b6-4ffe-8582-bf50de77e9ea Sep 28 18:03:42 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:42 devstack sudo[88630]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d666b1e0-ad48-4d79-bf18-2d09f720b697 tempest-DeleteServersTestJSON-837664681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-24645455-f8c8-4d4a-ace1-35ea439e8bac" returned: 0 in 0.279s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d666b1e0-ad48-4d79-bf18-2d09f720b697 tempest-DeleteServersTestJSON-837664681 None] Lock "cinder-quobyte-24645455-f8c8-4d4a-ace1-35ea439e8bac" released by "delete_volume" :: held 2.044s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:42 devstack cinder-volume[86980]: WARNING cinder.quota [None req-d666b1e0-ad48-4d79-bf18-2d09f720b697 tempest-DeleteServersTestJSON-837664681 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:03:42 devstack cinder-volume[86980]: WARNING cinder.quota [None req-d666b1e0-ad48-4d79-bf18-2d09f720b697 tempest-DeleteServersTestJSON-837664681 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:03:42 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-596728c2-e812-4c55-a03d-61c97960182f tempest-VolumesAdminNegativeTest-1986653264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5cd98054-50b6-4ffe-8582-bf50de77e9ea" returned: 0 in 0.340s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-596728c2-e812-4c55-a03d-61c97960182f tempest-VolumesAdminNegativeTest-1986653264 None] Lock "cinder-quobyte-5cd98054-50b6-4ffe-8582-bf50de77e9ea" released by "delete_volume" :: held 2.054s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:42 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-d666b1e0-ad48-4d79-bf18-2d09f720b697 tempest-DeleteServersTestJSON-837664681 None] Created reservations ['e8274ee2-b2bb-4316-95ce-3b1569b63af0', 'bccd51fa-506e-4f17-a8bb-c1aa0b148d12', '208e23ae-768c-4af1-88ef-7fd41f32bc54', '16ab9b21-76b6-4f82-b702-6334dc4801da'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:03:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d666b1e0-ad48-4d79-bf18-2d09f720b697 tempest-DeleteServersTestJSON-837664681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d666b1e0-ad48-4d79-bf18-2d09f720b697 tempest-DeleteServersTestJSON-837664681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d666b1e0-ad48-4d79-bf18-2d09f720b697 tempest-DeleteServersTestJSON-837664681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d666b1e0-ad48-4d79-bf18-2d09f720b697 tempest-DeleteServersTestJSON-837664681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d666b1e0-ad48-4d79-bf18-2d09f720b697 tempest-DeleteServersTestJSON-837664681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d666b1e0-ad48-4d79-bf18-2d09f720b697 tempest-DeleteServersTestJSON-837664681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:43 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-596728c2-e812-4c55-a03d-61c97960182f tempest-VolumesAdminNegativeTest-1986653264 None] Created reservations ['d83e896f-4409-4a7c-9bda-196d0bff9fd5', '764073d5-44a2-45d8-8f33-a716cf099b2b', '030044dc-d886-4a06-a08f-dfcb438d8cb1', 'dcac1882-29d2-47a7-9824-26a2559eed4a'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:03:43 devstack sudo[88638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:03:43 devstack sudo[88638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-596728c2-e812-4c55-a03d-61c97960182f tempest-VolumesAdminNegativeTest-1986653264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-596728c2-e812-4c55-a03d-61c97960182f tempest-VolumesAdminNegativeTest-1986653264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-596728c2-e812-4c55-a03d-61c97960182f tempest-VolumesAdminNegativeTest-1986653264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-596728c2-e812-4c55-a03d-61c97960182f tempest-VolumesAdminNegativeTest-1986653264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-596728c2-e812-4c55-a03d-61c97960182f tempest-VolumesAdminNegativeTest-1986653264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-596728c2-e812-4c55-a03d-61c97960182f tempest-VolumesAdminNegativeTest-1986653264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:43 devstack sudo[88640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:03:43 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:43 devstack sudo[88638]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d666b1e0-ad48-4d79-bf18-2d09f720b697 tempest-DeleteServersTestJSON-837664681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.321s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:43 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-d666b1e0-ad48-4d79-bf18-2d09f720b697 tempest-DeleteServersTestJSON-837664681 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:03:43 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-d666b1e0-ad48-4d79-bf18-2d09f720b697 tempest-DeleteServersTestJSON-837664681 None] Deleted volume successfully. Sep 28 18:03:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d666b1e0-ad48-4d79-bf18-2d09f720b697 tempest-DeleteServersTestJSON-837664681 None] Lock "cinder-24645455-f8c8-4d4a-ace1-35ea439e8bac-delete_volume" released by "delete_volume" :: held 2.869s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:43 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-596728c2-e812-4c55-a03d-61c97960182f tempest-VolumesAdminNegativeTest-1986653264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.304s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:43 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-596728c2-e812-4c55-a03d-61c97960182f tempest-VolumesAdminNegativeTest-1986653264 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:03:43 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-596728c2-e812-4c55-a03d-61c97960182f tempest-VolumesAdminNegativeTest-1986653264 None] Deleted volume successfully. Sep 28 18:03:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-596728c2-e812-4c55-a03d-61c97960182f tempest-VolumesAdminNegativeTest-1986653264 None] Lock "cinder-5cd98054-50b6-4ffe-8582-bf50de77e9ea-delete_volume" released by "delete_volume" :: held 2.783s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:03:47 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:03:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Flow 'volume_create_manager' (45ab7243-1f3a-47fa-a38e-595de0a1702d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa877ce5-a05c-406c-8153-529eb768de92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa877ce5-a05c-406c-8153-529eb768de92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1942160191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b836b7b-31b8-48a5-b61e-566f741deee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c0102863a64f04ac4fa794839d5428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:47Z,use_quota=True,user_id='cd04b843b2894f23961b6f17180615b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584efd91-f80c-4e9a-ac6a-bc2ca7083baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584efd91-f80c-4e9a-ac6a-bc2ca7083baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414164fd-5e0d-4d8e-8f44-5301a61bfdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414164fd-5e0d-4d8e-8f44-5301a61bfdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b836b7b-31b8-48a5-b61e-566f741deee5', 'volume_name': 'volume-9b836b7b-31b8-48a5-b61e-566f741deee5', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c0a7e95-0f16-402d-8cb1-13ab29c9f82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c0a7e95-0f16-402d-8cb1-13ab29c9f82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896ead71-ce31-42a1-9a94-0a27e9dc35ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:47 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Volume 9b836b7b-31b8-48a5-b61e-566f741deee5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b836b7b-31b8-48a5-b61e-566f741deee5', 'volume_size': 1} Sep 28 18:03:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:47 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1942160191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b836b7b-31b8-48a5-b61e-566f741deee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c0102863a64f04ac4fa794839d5428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:03:47Z,use_quota=True,user_id='cd04b843b2894f23961b6f17180615b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:03:47 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Creating volume 9b836b7b-31b8-48a5-b61e-566f741deee5 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:03:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:47 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:03:47 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:03:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:47 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:03:47 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:03:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b836b7b-31b8-48a5-b61e-566f741deee5 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:47 devstack sudo[88682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b836b7b-31b8-48a5-b61e-566f741deee5 1073741824 Sep 28 18:03:47 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:48 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b836b7b-31b8-48a5-b61e-566f741deee5 1073741824" returned: 0 in 0.683s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b836b7b-31b8-48a5-b61e-566f741deee5 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:03:48 devstack sudo[88691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b836b7b-31b8-48a5-b61e-566f741deee5 Sep 28 18:03:48 devstack sudo[88691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:03:48 devstack sudo[88691]: pam_unix(sudo:session): session closed for user root Sep 28 18:03:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b836b7b-31b8-48a5-b61e-566f741deee5" returned: 0 in 0.389s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:03:48 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:03:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:48 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896ead71-ce31-42a1-9a94-0a27e9dc35ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b836b7b-31b8-48a5-b61e-566f741deee5', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:48 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb340433-4e70-41b6-aed3-ff951a083675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:03:48 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Volume volume-9b836b7b-31b8-48a5-b61e-566f741deee5 (9b836b7b-31b8-48a5-b61e-566f741deee5): created successfully Sep 28 18:03:48 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb340433-4e70-41b6-aed3-ff951a083675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:03:48 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Flow 'volume_create_manager' (45ab7243-1f3a-47fa-a38e-595de0a1702d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:03:48 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-1cf35bba-1a7a-43de-a89b-843f4e7d49f8 tempest-AttachVolumeTestJSON-144497230 None] Created volume successfully. Sep 28 18:03:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-e23f45ba-f6ca-4cde-a33e-dae06ef5f6da req-371d98d8-469e-4c57-b935-e5ca43de85ce tempest-AttachVolumeTestJSON-144497230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:03:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-e23f45ba-f6ca-4cde-a33e-dae06ef5f6da req-371d98d8-469e-4c57-b935-e5ca43de85ce tempest-AttachVolumeTestJSON-144497230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:03:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-e23f45ba-f6ca-4cde-a33e-dae06ef5f6da req-371d98d8-469e-4c57-b935-e5ca43de85ce tempest-AttachVolumeTestJSON-144497230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:03:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-e23f45ba-f6ca-4cde-a33e-dae06ef5f6da req-371d98d8-469e-4c57-b935-e5ca43de85ce tempest-AttachVolumeTestJSON-144497230 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729', 'name': 'volume-9b836b7b-31b8-48a5-b61e-566f741deee5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eee2b32a-e84c-477c-94bc-af95717cee33', 'enforce_multipath': True} {{(pid=86980) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:03:50 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-e23f45ba-f6ca-4cde-a33e-dae06ef5f6da req-371d98d8-469e-4c57-b935-e5ca43de85ce tempest-AttachVolumeTestJSON-144497230 None] attachment_update completed successfully. Sep 28 18:04:00 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=29,cinder:UPDATE=30,cinder:INSERT=3,cinder:DELETE=2 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:04:00 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:UPDATE=26,cinder:SELECT=31,cinder:DELETE=3,cinder:INSERT=8 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:04:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:04:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:04 devstack sudo[89697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:04:04 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:04 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.386s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:04 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:04:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager._thread_info {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:04:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread count: 8 {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:04:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread info: [<_MainThread(MainThread, started 129097393381504)>, , , , , , , ] {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:04:21 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:04:31 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-5cb4a942-03ea-4a13-9e52-31df9cc4ed4a req-b612c62d-8551-4e85-9f8c-1a7f78a9a0c4 tempest-AttachVolumeTestJSON-144497230 None] Terminate volume connection completed successfully. Sep 28 18:04:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-5cb4a942-03ea-4a13-9e52-31df9cc4ed4a req-b612c62d-8551-4e85-9f8c-1a7f78a9a0c4 tempest-AttachVolumeTestJSON-144497230 None] Deleting attachment eee2b32a-e84c-477c-94bc-af95717cee33. {{(pid=86980) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:04:41 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=1 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:04:41 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=1 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:04:55 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:04:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Flow 'volume_create_manager' (e48a4ad1-7691-4e1c-9522-5f0bb9b7683d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:04:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a511ee9e-32c7-43a3-93ab-04b6eff99e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a511ee9e-32c7-43a3-93ab-04b6eff99e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-509201204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f2fd418-ef18-4a78-99b9-f0f78d48367c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e106cff6994695835ebfd5398bacc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:56Z,use_quota=True,user_id='9d4a9fb26f5548ee90b4d175be281814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3505000d-cb5a-40ba-a9f2-ae4a887f024d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3505000d-cb5a-40ba-a9f2-ae4a887f024d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fb7c52b-6249-4a18-91ff-8109a5618509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fb7c52b-6249-4a18-91ff-8109a5618509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f2fd418-ef18-4a78-99b9-f0f78d48367c', 'volume_name': 'volume-4f2fd418-ef18-4a78-99b9-f0f78d48367c', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc22672c-4f83-4a40-a0b8-521b985f5fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc22672c-4f83-4a40-a0b8-521b985f5fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03eb0923-ae70-4fcf-b7ee-51d05413da69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:55 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Volume 4f2fd418-ef18-4a78-99b9-f0f78d48367c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f2fd418-ef18-4a78-99b9-f0f78d48367c', 'volume_size': 1} Sep 28 18:04:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:55 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-509201204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f2fd418-ef18-4a78-99b9-f0f78d48367c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e106cff6994695835ebfd5398bacc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:04:56Z,use_quota=True,user_id='9d4a9fb26f5548ee90b4d175be281814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:04:55 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Creating volume 4f2fd418-ef18-4a78-99b9-f0f78d48367c {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:04:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:04:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:04:55 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:04:55 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:04:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:55 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:04:55 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:04:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4f2fd418-ef18-4a78-99b9-f0f78d48367c 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:55 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4f2fd418-ef18-4a78-99b9-f0f78d48367c 1073741824 Sep 28 18:04:55 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:56 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4f2fd418-ef18-4a78-99b9-f0f78d48367c 1073741824" returned: 0 in 0.778s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4f2fd418-ef18-4a78-99b9-f0f78d48367c {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:04:56 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4f2fd418-ef18-4a78-99b9-f0f78d48367c Sep 28 18:04:56 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:04:57 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Sep 28 18:04:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4f2fd418-ef18-4a78-99b9-f0f78d48367c" returned: 0 in 0.488s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:04:57 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:04:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:04:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03eb0923-ae70-4fcf-b7ee-51d05413da69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f2fd418-ef18-4a78-99b9-f0f78d48367c', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a660bc8c-c4a9-4cd8-8378-d795a7603018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:04:57 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Volume volume-4f2fd418-ef18-4a78-99b9-f0f78d48367c (4f2fd418-ef18-4a78-99b9-f0f78d48367c): created successfully Sep 28 18:04:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a660bc8c-c4a9-4cd8-8378-d795a7603018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:04:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Flow 'volume_create_manager' (e48a4ad1-7691-4e1c-9522-5f0bb9b7683d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:04:57 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-6bbde8d3-50b4-4039-91d0-90fb3f56b539 tempest-ServerRescueNegativeTestJSON-301170625 None] Created volume successfully. Sep 28 18:05:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:05:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:04 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:05:04 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:05 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.643s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:05 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:05:05 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager._thread_info {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:05:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread count: 8 {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:05:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread info: [<_MainThread(MainThread, started 129097393381504)>, , , , , , , ] {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:05:07 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:05:07 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:05:12 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-29ac4eb4-26a6-4389-8976-f13ea81ee8ee tempest-ServerRescueNegativeTestJSON-301170625 None] Acquiring lock "cinder-4f2fd418-ef18-4a78-99b9-f0f78d48367c-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:12 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-29ac4eb4-26a6-4389-8976-f13ea81ee8ee tempest-ServerRescueNegativeTestJSON-301170625 None] Lock "cinder-4f2fd418-ef18-4a78-99b9-f0f78d48367c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:12 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-29ac4eb4-26a6-4389-8976-f13ea81ee8ee tempest-ServerRescueNegativeTestJSON-301170625 None] Acquiring lock "cinder-quobyte-4f2fd418-ef18-4a78-99b9-f0f78d48367c" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:12 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-29ac4eb4-26a6-4389-8976-f13ea81ee8ee tempest-ServerRescueNegativeTestJSON-301170625 None] Lock "cinder-quobyte-4f2fd418-ef18-4a78-99b9-f0f78d48367c" acquired by "delete_volume" :: waited 0.043s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:12 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc2ef73-1ca2-4622-9bbf-98a7c3effd33]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-29ac4eb4-26a6-4389-8976-f13ea81ee8ee tempest-ServerRescueNegativeTestJSON-301170625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4f2fd418-ef18-4a78-99b9-f0f78d48367c {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:12 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4f2fd418-ef18-4a78-99b9-f0f78d48367c Sep 28 18:05:12 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:12 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-29ac4eb4-26a6-4389-8976-f13ea81ee8ee tempest-ServerRescueNegativeTestJSON-301170625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4f2fd418-ef18-4a78-99b9-f0f78d48367c" returned: 0 in 0.586s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-29ac4eb4-26a6-4389-8976-f13ea81ee8ee tempest-ServerRescueNegativeTestJSON-301170625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4f2fd418-ef18-4a78-99b9-f0f78d48367c {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:12 devstack sudo[90531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4f2fd418-ef18-4a78-99b9-f0f78d48367c Sep 28 18:05:12 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:13 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-29ac4eb4-26a6-4389-8976-f13ea81ee8ee tempest-ServerRescueNegativeTestJSON-301170625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4f2fd418-ef18-4a78-99b9-f0f78d48367c" returned: 0 in 0.297s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:13 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-29ac4eb4-26a6-4389-8976-f13ea81ee8ee tempest-ServerRescueNegativeTestJSON-301170625 None] Lock "cinder-quobyte-4f2fd418-ef18-4a78-99b9-f0f78d48367c" released by "delete_volume" :: held 0.962s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:13 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-29ac4eb4-26a6-4389-8976-f13ea81ee8ee tempest-ServerRescueNegativeTestJSON-301170625 None] Created reservations ['cc6330a1-4e32-40c0-8266-9bb214b5f379', '9e01fdaf-8d83-4d82-bc5d-015facdc4d7f', 'c44eee44-9d20-4242-a2d8-1e1955d280e2', '305983c3-7e1c-42be-9aa9-667fe84e79f6'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:05:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-29ac4eb4-26a6-4389-8976-f13ea81ee8ee tempest-ServerRescueNegativeTestJSON-301170625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-29ac4eb4-26a6-4389-8976-f13ea81ee8ee tempest-ServerRescueNegativeTestJSON-301170625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:13 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-29ac4eb4-26a6-4389-8976-f13ea81ee8ee tempest-ServerRescueNegativeTestJSON-301170625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:13 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-29ac4eb4-26a6-4389-8976-f13ea81ee8ee tempest-ServerRescueNegativeTestJSON-301170625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-29ac4eb4-26a6-4389-8976-f13ea81ee8ee tempest-ServerRescueNegativeTestJSON-301170625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-29ac4eb4-26a6-4389-8976-f13ea81ee8ee tempest-ServerRescueNegativeTestJSON-301170625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:13 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:05:13 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:13 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-29ac4eb4-26a6-4389-8976-f13ea81ee8ee tempest-ServerRescueNegativeTestJSON-301170625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.376s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:13 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-29ac4eb4-26a6-4389-8976-f13ea81ee8ee tempest-ServerRescueNegativeTestJSON-301170625 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:05:13 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-29ac4eb4-26a6-4389-8976-f13ea81ee8ee tempest-ServerRescueNegativeTestJSON-301170625 None] Deleted volume successfully. Sep 28 18:05:13 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-29ac4eb4-26a6-4389-8976-f13ea81ee8ee tempest-ServerRescueNegativeTestJSON-301170625 None] Lock "cinder-4f2fd418-ef18-4a78-99b9-f0f78d48367c-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:18 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:05:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Flow 'volume_create_manager' (0d4fa2cf-027d-4c04-82b1-60222162ebe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88787f31-f74b-474c-9280-094f45ece4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88787f31-f74b-474c-9280-094f45ece4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-381539910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa608ea7-6718-459b-b622-ed2567fe7654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dea64611b2e464fb9754b195a49404b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:18Z,use_quota=True,user_id='cd198dd8e13546c9a4aeda280a7a02d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc075a7-7819-48cc-b565-5d8ba4dcca9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc075a7-7819-48cc-b565-5d8ba4dcca9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b97393-e141-4748-b7a6-6b0276e0cf0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b97393-e141-4748-b7a6-6b0276e0cf0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa608ea7-6718-459b-b622-ed2567fe7654', 'volume_name': 'volume-aa608ea7-6718-459b-b622-ed2567fe7654', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c80706c8-ff12-4dc6-b139-4e28bf2677bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c80706c8-ff12-4dc6-b139-4e28bf2677bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de304ec0-bcd7-459e-a747-cef91e0ade72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:18 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Volume aa608ea7-6718-459b-b622-ed2567fe7654: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa608ea7-6718-459b-b622-ed2567fe7654', 'volume_size': 1} Sep 28 18:05:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-381539910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa608ea7-6718-459b-b622-ed2567fe7654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dea64611b2e464fb9754b195a49404b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:18Z,use_quota=True,user_id='cd198dd8e13546c9a4aeda280a7a02d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:05:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Creating volume aa608ea7-6718-459b-b622-ed2567fe7654 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:05:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:05:18 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:05:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-aa608ea7-6718-459b-b622-ed2567fe7654 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:18 devstack sudo[90574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-aa608ea7-6718-459b-b622-ed2567fe7654 1073741824 Sep 28 18:05:18 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:18 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-aa608ea7-6718-459b-b622-ed2567fe7654 1073741824" returned: 0 in 0.718s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-aa608ea7-6718-459b-b622-ed2567fe7654 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:19 devstack sudo[90601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-aa608ea7-6718-459b-b622-ed2567fe7654 Sep 28 18:05:19 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:19 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-aa608ea7-6718-459b-b622-ed2567fe7654" returned: 0 in 0.294s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:05:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:19 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de304ec0-bcd7-459e-a747-cef91e0ade72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa608ea7-6718-459b-b622-ed2567fe7654', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:19 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67bff06-c464-4abb-b8bf-63c2600be1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:19 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Volume volume-aa608ea7-6718-459b-b622-ed2567fe7654 (aa608ea7-6718-459b-b622-ed2567fe7654): created successfully Sep 28 18:05:19 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67bff06-c464-4abb-b8bf-63c2600be1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:19 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Flow 'volume_create_manager' (0d4fa2cf-027d-4c04-82b1-60222162ebe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:19 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-86c305e3-d7ab-4b85-aba5-8ee1f2133c55 tempest-ServerActionsTestOtherA-1750096549 None] Created volume successfully. Sep 28 18:05:24 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:05:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Flow 'volume_create_manager' (5ab07900-127d-4783-b48b-2984e11dc463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7937296a-2839-403a-9210-db440da2160e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7937296a-2839-403a-9210-db440da2160e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1706924805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c83ddfd-fd10-4e96-87ed-b783b06da62a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5bf3a69c8f847c08d25352e1b0af68a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:25Z,use_quota=True,user_id='b44cf9605543427a8715b2f2648ab53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d86655b5-d64a-4333-9976-59e531d4f190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d86655b5-d64a-4333-9976-59e531d4f190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f05336b-909b-4f4d-bf73-7e362594718e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f05336b-909b-4f4d-bf73-7e362594718e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c83ddfd-fd10-4e96-87ed-b783b06da62a', 'volume_name': 'volume-3c83ddfd-fd10-4e96-87ed-b783b06da62a', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0584d9d-5a12-47ab-9753-25a7b168970f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0584d9d-5a12-47ab-9753-25a7b168970f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea77e762-ef65-4113-8c6d-b56a583b087d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:24 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Volume 3c83ddfd-fd10-4e96-87ed-b783b06da62a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c83ddfd-fd10-4e96-87ed-b783b06da62a', 'volume_size': 1} Sep 28 18:05:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:24 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1706924805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c83ddfd-fd10-4e96-87ed-b783b06da62a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5bf3a69c8f847c08d25352e1b0af68a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:25Z,use_quota=True,user_id='b44cf9605543427a8715b2f2648ab53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:05:24 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Creating volume 3c83ddfd-fd10-4e96-87ed-b783b06da62a {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:05:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:24 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:24 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:24 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:05:24 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:05:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3c83ddfd-fd10-4e96-87ed-b783b06da62a 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:24 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3c83ddfd-fd10-4e96-87ed-b783b06da62a 1073741824 Sep 28 18:05:24 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:25 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3c83ddfd-fd10-4e96-87ed-b783b06da62a 1073741824" returned: 0 in 0.661s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3c83ddfd-fd10-4e96-87ed-b783b06da62a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:25 devstack sudo[90627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3c83ddfd-fd10-4e96-87ed-b783b06da62a Sep 28 18:05:25 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:25 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3c83ddfd-fd10-4e96-87ed-b783b06da62a" returned: 0 in 0.347s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:25 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:05:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea77e762-ef65-4113-8c6d-b56a583b087d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c83ddfd-fd10-4e96-87ed-b783b06da62a', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b82c46f-2e5e-4e41-a861-e41d06c1b950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:25 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Volume volume-3c83ddfd-fd10-4e96-87ed-b783b06da62a (3c83ddfd-fd10-4e96-87ed-b783b06da62a): created successfully Sep 28 18:05:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b82c46f-2e5e-4e41-a861-e41d06c1b950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Flow 'volume_create_manager' (5ab07900-127d-4783-b48b-2984e11dc463) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:25 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-f6e6d85b-cdc7-41f6-8b0a-f35ff0e432ce tempest-TaggedAttachmentsTest-889441576 None] Created volume successfully. Sep 28 18:05:35 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:UPDATE=15,cinder:SELECT=8,cinder:INSERT=4 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:05:35 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=10,cinder:INSERT=2,cinder:UPDATE=13,cinder:DELETE=3 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:05:37 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:05:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Flow 'volume_create_manager' (b42517e2-bed2-44f2-b853-e69f9853e302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aca6dee-3b2e-473c-b5f8-0612bf1025b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aca6dee-3b2e-473c-b5f8-0612bf1025b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2072600970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec240487-dd42-4b02-bad5-9581ba026fc5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='03a570ffb0c9427d9ff4cd37e721a676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:37Z,use_quota=True,user_id='666b97f36f764652aa60a20456992172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec10350-ca46-4377-a22d-46066c11f102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec10350-ca46-4377-a22d-46066c11f102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a2d814-91d9-4e9c-8a75-21c926ac625b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a2d814-91d9-4e9c-8a75-21c926ac625b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec240487-dd42-4b02-bad5-9581ba026fc5', 'volume_name': 'volume-ec240487-dd42-4b02-bad5-9581ba026fc5', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75730716-e711-4d88-94e8-ae6b27d0ce0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75730716-e711-4d88-94e8-ae6b27d0ce0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc975a99-8665-4fe9-9f49-082e7f26f9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:37 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Volume ec240487-dd42-4b02-bad5-9581ba026fc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec240487-dd42-4b02-bad5-9581ba026fc5', 'volume_size': 1} Sep 28 18:05:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2072600970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec240487-dd42-4b02-bad5-9581ba026fc5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='03a570ffb0c9427d9ff4cd37e721a676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:37Z,use_quota=True,user_id='666b97f36f764652aa60a20456992172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:05:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Creating volume ec240487-dd42-4b02-bad5-9581ba026fc5 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:05:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:05:37 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:05:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ec240487-dd42-4b02-bad5-9581ba026fc5 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:37 devstack sudo[90762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ec240487-dd42-4b02-bad5-9581ba026fc5 1073741824 Sep 28 18:05:37 devstack sudo[90762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:37 devstack sudo[90762]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ec240487-dd42-4b02-bad5-9581ba026fc5 1073741824" returned: 0 in 0.654s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ec240487-dd42-4b02-bad5-9581ba026fc5 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:38 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ec240487-dd42-4b02-bad5-9581ba026fc5 Sep 28 18:05:38 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:38 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ec240487-dd42-4b02-bad5-9581ba026fc5" returned: 0 in 0.384s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:05:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc975a99-8665-4fe9-9f49-082e7f26f9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec240487-dd42-4b02-bad5-9581ba026fc5', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1983f11-d0e1-432a-bee6-4d806c646339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:38 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Volume volume-ec240487-dd42-4b02-bad5-9581ba026fc5 (ec240487-dd42-4b02-bad5-9581ba026fc5): created successfully Sep 28 18:05:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1983f11-d0e1-432a-bee6-4d806c646339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Flow 'volume_create_manager' (b42517e2-bed2-44f2-b853-e69f9853e302) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:38 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-8e937540-f5bc-46e8-a621-d5724bd78068 req-1345bb86-dc91-4575-ab1d-2103cd82878f tempest-VolumesGetTestJSON-1293278516 None] Created volume successfully. Sep 28 18:05:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-75627278-16e7-425e-9e74-8e64b7b2309f req-df721d87-133a-42a5-86a4-59cba93f0d67 tempest-VolumesGetTestJSON-1293278516 None] Acquiring lock "cinder-ec240487-dd42-4b02-bad5-9581ba026fc5-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-75627278-16e7-425e-9e74-8e64b7b2309f req-df721d87-133a-42a5-86a4-59cba93f0d67 tempest-VolumesGetTestJSON-1293278516 None] Lock "cinder-ec240487-dd42-4b02-bad5-9581ba026fc5-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-75627278-16e7-425e-9e74-8e64b7b2309f req-df721d87-133a-42a5-86a4-59cba93f0d67 tempest-VolumesGetTestJSON-1293278516 None] Acquiring lock "cinder-quobyte-ec240487-dd42-4b02-bad5-9581ba026fc5" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:05:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-75627278-16e7-425e-9e74-8e64b7b2309f req-df721d87-133a-42a5-86a4-59cba93f0d67 tempest-VolumesGetTestJSON-1293278516 None] Lock "cinder-quobyte-ec240487-dd42-4b02-bad5-9581ba026fc5" acquired by "delete_volume" :: waited 0.035s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:05:40 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[333a3726-e939-4556-bc99-16a593e42f94]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:05:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-75627278-16e7-425e-9e74-8e64b7b2309f req-df721d87-133a-42a5-86a4-59cba93f0d67 tempest-VolumesGetTestJSON-1293278516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ec240487-dd42-4b02-bad5-9581ba026fc5 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:40 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ec240487-dd42-4b02-bad5-9581ba026fc5 Sep 28 18:05:40 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:41 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-75627278-16e7-425e-9e74-8e64b7b2309f req-df721d87-133a-42a5-86a4-59cba93f0d67 tempest-VolumesGetTestJSON-1293278516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ec240487-dd42-4b02-bad5-9581ba026fc5" returned: 0 in 0.624s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-75627278-16e7-425e-9e74-8e64b7b2309f req-df721d87-133a-42a5-86a4-59cba93f0d67 tempest-VolumesGetTestJSON-1293278516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ec240487-dd42-4b02-bad5-9581ba026fc5 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:41 devstack sudo[90785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ec240487-dd42-4b02-bad5-9581ba026fc5 Sep 28 18:05:41 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:41 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-75627278-16e7-425e-9e74-8e64b7b2309f req-df721d87-133a-42a5-86a4-59cba93f0d67 tempest-VolumesGetTestJSON-1293278516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ec240487-dd42-4b02-bad5-9581ba026fc5" returned: 0 in 0.797s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-75627278-16e7-425e-9e74-8e64b7b2309f req-df721d87-133a-42a5-86a4-59cba93f0d67 tempest-VolumesGetTestJSON-1293278516 None] Lock "cinder-quobyte-ec240487-dd42-4b02-bad5-9581ba026fc5" released by "delete_volume" :: held 1.537s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:41 devstack cinder-volume[86980]: DEBUG cinder.quota [req-75627278-16e7-425e-9e74-8e64b7b2309f req-df721d87-133a-42a5-86a4-59cba93f0d67 tempest-VolumesGetTestJSON-1293278516 None] Created reservations ['6e178b44-634f-4d0a-8ece-690dc1bec1a7', 'f0aa3af5-763f-45e6-8166-f96b339661fd', 'b59abb7b-6795-4dc5-bdf8-daa37f9b8c3c', 'f4c8f459-b067-4e24-bf07-0b6d2f926871'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:05:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-75627278-16e7-425e-9e74-8e64b7b2309f req-df721d87-133a-42a5-86a4-59cba93f0d67 tempest-VolumesGetTestJSON-1293278516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-75627278-16e7-425e-9e74-8e64b7b2309f req-df721d87-133a-42a5-86a4-59cba93f0d67 tempest-VolumesGetTestJSON-1293278516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [req-75627278-16e7-425e-9e74-8e64b7b2309f req-df721d87-133a-42a5-86a4-59cba93f0d67 tempest-VolumesGetTestJSON-1293278516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [req-75627278-16e7-425e-9e74-8e64b7b2309f req-df721d87-133a-42a5-86a4-59cba93f0d67 tempest-VolumesGetTestJSON-1293278516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-75627278-16e7-425e-9e74-8e64b7b2309f req-df721d87-133a-42a5-86a4-59cba93f0d67 tempest-VolumesGetTestJSON-1293278516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-75627278-16e7-425e-9e74-8e64b7b2309f req-df721d87-133a-42a5-86a4-59cba93f0d67 tempest-VolumesGetTestJSON-1293278516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:42 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:05:42 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:42 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-75627278-16e7-425e-9e74-8e64b7b2309f req-df721d87-133a-42a5-86a4-59cba93f0d67 tempest-VolumesGetTestJSON-1293278516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.750s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:42 devstack cinder-volume[86980]: DEBUG cinder.manager [req-75627278-16e7-425e-9e74-8e64b7b2309f req-df721d87-133a-42a5-86a4-59cba93f0d67 tempest-VolumesGetTestJSON-1293278516 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:05:42 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-75627278-16e7-425e-9e74-8e64b7b2309f req-df721d87-133a-42a5-86a4-59cba93f0d67 tempest-VolumesGetTestJSON-1293278516 None] Deleted volume successfully. Sep 28 18:05:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-75627278-16e7-425e-9e74-8e64b7b2309f req-df721d87-133a-42a5-86a4-59cba93f0d67 tempest-VolumesGetTestJSON-1293278516 None] Lock "cinder-ec240487-dd42-4b02-bad5-9581ba026fc5-delete_volume" released by "delete_volume" :: held 2.756s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:05:50 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:05:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Flow 'volume_create_manager' (41d0c7e0-df06-4b69-bf69-f99c819c8e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c04366-5dbb-48db-9221-4e44768ea3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c04366-5dbb-48db-9221-4e44768ea3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-809022635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e44bb51a-6e18-4196-9737-53520833678d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3cb07a86b00145139311c0ca8a874517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:50Z,use_quota=True,user_id='438fcd628d9b4a2b8bacd11712f3b07d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (537cf186-1ae2-4210-995a-7aa609e73d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (537cf186-1ae2-4210-995a-7aa609e73d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f0aacc-026f-4537-994f-76595120329e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f0aacc-026f-4537-994f-76595120329e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e44bb51a-6e18-4196-9737-53520833678d', 'volume_name': 'volume-e44bb51a-6e18-4196-9737-53520833678d', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08cd230-c274-4514-a2ac-a5aca6fa7c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08cd230-c274-4514-a2ac-a5aca6fa7c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb85970-16fa-443e-acb1-a3e3a0de2bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:50 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Volume e44bb51a-6e18-4196-9737-53520833678d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e44bb51a-6e18-4196-9737-53520833678d', 'volume_size': 1} Sep 28 18:05:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-809022635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e44bb51a-6e18-4196-9737-53520833678d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3cb07a86b00145139311c0ca8a874517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:50Z,use_quota=True,user_id='438fcd628d9b4a2b8bacd11712f3b07d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:05:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Creating volume e44bb51a-6e18-4196-9737-53520833678d {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:05:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:05:50 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:05:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e44bb51a-6e18-4196-9737-53520833678d 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:50 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e44bb51a-6e18-4196-9737-53520833678d 1073741824 Sep 28 18:05:50 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:51 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e44bb51a-6e18-4196-9737-53520833678d 1073741824" returned: 0 in 0.618s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e44bb51a-6e18-4196-9737-53520833678d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:51 devstack sudo[90973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e44bb51a-6e18-4196-9737-53520833678d Sep 28 18:05:51 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:51 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e44bb51a-6e18-4196-9737-53520833678d" returned: 0 in 0.440s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:51 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:05:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb85970-16fa-443e-acb1-a3e3a0de2bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e44bb51a-6e18-4196-9737-53520833678d', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (070e828f-1558-48d3-a308-259092851d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:51 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Volume volume-e44bb51a-6e18-4196-9737-53520833678d (e44bb51a-6e18-4196-9737-53520833678d): created successfully Sep 28 18:05:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (070e828f-1558-48d3-a308-259092851d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Flow 'volume_create_manager' (41d0c7e0-df06-4b69-bf69-f99c819c8e1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:51 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-b77dd734-8635-4cc9-87f2-f5ab5d9c254b tempest-VolumesTestJSON-31454246 None] Created volume successfully. Sep 28 18:05:53 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:05:53 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Flow 'volume_create_manager' (fa436c11-bfc7-4187-a8b5-41c989c92e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:53 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6001d62-a6c0-43bb-9c1a-cac0460f2d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:53 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6001d62-a6c0-43bb-9c1a-cac0460f2d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2056474290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b54023-4ef2-40b2-b7b7-c1530a558ee1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3cb07a86b00145139311c0ca8a874517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:54Z,use_quota=True,user_id='438fcd628d9b4a2b8bacd11712f3b07d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:53 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72103450-c0ff-4ddd-b3b9-a5faac933a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:53 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72103450-c0ff-4ddd-b3b9-a5faac933a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:53 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467b13c8-6c39-42fc-9778-7b37000f3152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:53 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467b13c8-6c39-42fc-9778-7b37000f3152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83b54023-4ef2-40b2-b7b7-c1530a558ee1', 'volume_name': 'volume-83b54023-4ef2-40b2-b7b7-c1530a558ee1', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:53 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f58f23d4-1e9e-47da-b6c5-f18517024e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:53 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f58f23d4-1e9e-47da-b6c5-f18517024e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:53 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (867095e8-5101-4ece-8132-d1cd0061c900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:53 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Volume 83b54023-4ef2-40b2-b7b7-c1530a558ee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83b54023-4ef2-40b2-b7b7-c1530a558ee1', 'volume_size': 1} Sep 28 18:05:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2056474290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b54023-4ef2-40b2-b7b7-c1530a558ee1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3cb07a86b00145139311c0ca8a874517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:54Z,use_quota=True,user_id='438fcd628d9b4a2b8bacd11712f3b07d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:05:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Creating volume 83b54023-4ef2-40b2-b7b7-c1530a558ee1 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:05:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:05:53 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:05:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-83b54023-4ef2-40b2-b7b7-c1530a558ee1 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:53 devstack sudo[91059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-83b54023-4ef2-40b2-b7b7-c1530a558ee1 1073741824 Sep 28 18:05:53 devstack sudo[91059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:54 devstack sudo[91059]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-83b54023-4ef2-40b2-b7b7-c1530a558ee1 1073741824" returned: 0 in 0.490s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-83b54023-4ef2-40b2-b7b7-c1530a558ee1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:54 devstack sudo[91064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-83b54023-4ef2-40b2-b7b7-c1530a558ee1 Sep 28 18:05:54 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:54 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-83b54023-4ef2-40b2-b7b7-c1530a558ee1" returned: 0 in 0.313s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:05:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (867095e8-5101-4ece-8132-d1cd0061c900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83b54023-4ef2-40b2-b7b7-c1530a558ee1', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee5e9d9-65c6-4703-bd37-f495c4373241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:54 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Volume volume-83b54023-4ef2-40b2-b7b7-c1530a558ee1 (83b54023-4ef2-40b2-b7b7-c1530a558ee1): created successfully Sep 28 18:05:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee5e9d9-65c6-4703-bd37-f495c4373241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Flow 'volume_create_manager' (fa436c11-bfc7-4187-a8b5-41c989c92e40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:54 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-65120008-ef39-4aa3-9c76-7e2fd6013d28 tempest-VolumesTestJSON-31454246 None] Created volume successfully. Sep 28 18:05:56 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:05:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Flow 'volume_create_manager' (250ab8ac-7dbb-4b77-9091-0ec79ce5806d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5b3a33-4d3b-415a-a91f-f4543f539908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5b3a33-4d3b-415a-a91f-f4543f539908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1932590883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d23967d2-b540-4114-be7e-1fb66d05b9f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3cb07a86b00145139311c0ca8a874517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:57Z,use_quota=True,user_id='438fcd628d9b4a2b8bacd11712f3b07d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f272e135-1fae-46ce-83d8-601d2279bd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f272e135-1fae-46ce-83d8-601d2279bd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51fc3ecd-48d0-4750-a42d-7c794af3418e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51fc3ecd-48d0-4750-a42d-7c794af3418e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd23967d2-b540-4114-be7e-1fb66d05b9f2', 'volume_name': 'volume-d23967d2-b540-4114-be7e-1fb66d05b9f2', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ecd855b-bd92-4218-aa34-089a7bf5b92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ecd855b-bd92-4218-aa34-089a7bf5b92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a17ff7-131b-4f59-871f-4723b7e15c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:56 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Volume d23967d2-b540-4114-be7e-1fb66d05b9f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d23967d2-b540-4114-be7e-1fb66d05b9f2', 'volume_size': 1} Sep 28 18:05:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1932590883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d23967d2-b540-4114-be7e-1fb66d05b9f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3cb07a86b00145139311c0ca8a874517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:05:57Z,use_quota=True,user_id='438fcd628d9b4a2b8bacd11712f3b07d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:05:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Creating volume d23967d2-b540-4114-be7e-1fb66d05b9f2 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:05:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:05:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:05:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:05:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:05:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:05:56 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:05:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d23967d2-b540-4114-be7e-1fb66d05b9f2 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:56 devstack sudo[91070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d23967d2-b540-4114-be7e-1fb66d05b9f2 1073741824 Sep 28 18:05:56 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:57 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d23967d2-b540-4114-be7e-1fb66d05b9f2 1073741824" returned: 0 in 0.789s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d23967d2-b540-4114-be7e-1fb66d05b9f2 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:05:57 devstack sudo[91077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d23967d2-b540-4114-be7e-1fb66d05b9f2 Sep 28 18:05:57 devstack sudo[91077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:05:58 devstack sudo[91077]: pam_unix(sudo:session): session closed for user root Sep 28 18:05:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d23967d2-b540-4114-be7e-1fb66d05b9f2" returned: 0 in 0.762s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:05:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:05:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:05:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a17ff7-131b-4f59-871f-4723b7e15c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d23967d2-b540-4114-be7e-1fb66d05b9f2', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd327165-7e3b-4e25-8740-9578fa8c0e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:05:58 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Volume volume-d23967d2-b540-4114-be7e-1fb66d05b9f2 (d23967d2-b540-4114-be7e-1fb66d05b9f2): created successfully Sep 28 18:05:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd327165-7e3b-4e25-8740-9578fa8c0e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:05:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Flow 'volume_create_manager' (250ab8ac-7dbb-4b77-9091-0ec79ce5806d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:05:58 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-ea634caf-0df5-4bae-a13b-36ac60ca729b tempest-VolumesTestJSON-31454246 None] Created volume successfully. Sep 28 18:06:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d1f8bae2-69f5-4d31-9824-eaae58e1c458 tempest-VolumesTestJSON-31454246 None] Acquiring lock "cinder-d23967d2-b540-4114-be7e-1fb66d05b9f2-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d1f8bae2-69f5-4d31-9824-eaae58e1c458 tempest-VolumesTestJSON-31454246 None] Lock "cinder-d23967d2-b540-4114-be7e-1fb66d05b9f2-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d1f8bae2-69f5-4d31-9824-eaae58e1c458 tempest-VolumesTestJSON-31454246 None] Acquiring lock "cinder-quobyte-d23967d2-b540-4114-be7e-1fb66d05b9f2" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d1f8bae2-69f5-4d31-9824-eaae58e1c458 tempest-VolumesTestJSON-31454246 None] Lock "cinder-quobyte-d23967d2-b540-4114-be7e-1fb66d05b9f2" acquired by "delete_volume" :: waited 0.025s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:00 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4b7f27-bebd-4855-a802-36d89731b454]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d1f8bae2-69f5-4d31-9824-eaae58e1c458 tempest-VolumesTestJSON-31454246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d23967d2-b540-4114-be7e-1fb66d05b9f2 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-aa7e7364-9d4f-4447-9e56-e638982c2957 req-a58c9a16-b98c-42f5-8876-4e51eff340b1 tempest-ServerActionsTestOtherA-1750096549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-aa7e7364-9d4f-4447-9e56-e638982c2957 req-a58c9a16-b98c-42f5-8876-4e51eff340b1 tempest-ServerActionsTestOtherA-1750096549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:00 devstack sudo[91138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d23967d2-b540-4114-be7e-1fb66d05b9f2 Sep 28 18:06:00 devstack sudo[91138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-aa7e7364-9d4f-4447-9e56-e638982c2957 req-a58c9a16-b98c-42f5-8876-4e51eff340b1 tempest-ServerActionsTestOtherA-1750096549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-aa7e7364-9d4f-4447-9e56-e638982c2957 req-a58c9a16-b98c-42f5-8876-4e51eff340b1 tempest-ServerActionsTestOtherA-1750096549 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729', 'name': 'volume-aa608ea7-6718-459b-b622-ed2567fe7654', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e03de5f7-8ca7-4d93-8bb8-f35439555ab2', 'enforce_multipath': True} {{(pid=86980) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:06:01 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-aa7e7364-9d4f-4447-9e56-e638982c2957 req-a58c9a16-b98c-42f5-8876-4e51eff340b1 tempest-ServerActionsTestOtherA-1750096549 None] attachment_update completed successfully. Sep 28 18:06:01 devstack sudo[91138]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d1f8bae2-69f5-4d31-9824-eaae58e1c458 tempest-VolumesTestJSON-31454246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d23967d2-b540-4114-be7e-1fb66d05b9f2" returned: 0 in 0.831s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d1f8bae2-69f5-4d31-9824-eaae58e1c458 tempest-VolumesTestJSON-31454246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d23967d2-b540-4114-be7e-1fb66d05b9f2 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:01 devstack sudo[91526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d23967d2-b540-4114-be7e-1fb66d05b9f2 Sep 28 18:06:01 devstack sudo[91526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:01 devstack sudo[91526]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d1f8bae2-69f5-4d31-9824-eaae58e1c458 tempest-VolumesTestJSON-31454246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d23967d2-b540-4114-be7e-1fb66d05b9f2" returned: 0 in 0.377s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d1f8bae2-69f5-4d31-9824-eaae58e1c458 tempest-VolumesTestJSON-31454246 None] Lock "cinder-quobyte-d23967d2-b540-4114-be7e-1fb66d05b9f2" released by "delete_volume" :: held 1.292s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:02 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-d1f8bae2-69f5-4d31-9824-eaae58e1c458 tempest-VolumesTestJSON-31454246 None] Created reservations ['902177b3-316e-4b7b-b8dc-63115f2a684e', 'd745cc40-ac9e-44b1-a290-34a96efb98f2', '42bfce51-345c-489f-9192-cc3285d34455', 'aad02234-a12e-45ba-839b-777e0f6df457'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d1f8bae2-69f5-4d31-9824-eaae58e1c458 tempest-VolumesTestJSON-31454246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d1f8bae2-69f5-4d31-9824-eaae58e1c458 tempest-VolumesTestJSON-31454246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d1f8bae2-69f5-4d31-9824-eaae58e1c458 tempest-VolumesTestJSON-31454246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d1f8bae2-69f5-4d31-9824-eaae58e1c458 tempest-VolumesTestJSON-31454246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d1f8bae2-69f5-4d31-9824-eaae58e1c458 tempest-VolumesTestJSON-31454246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d1f8bae2-69f5-4d31-9824-eaae58e1c458 tempest-VolumesTestJSON-31454246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:02 devstack sudo[91566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:06:02 devstack sudo[91566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:02 devstack sudo[91566]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d1f8bae2-69f5-4d31-9824-eaae58e1c458 tempest-VolumesTestJSON-31454246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.353s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:02 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-d1f8bae2-69f5-4d31-9824-eaae58e1c458 tempest-VolumesTestJSON-31454246 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:06:02 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-d1f8bae2-69f5-4d31-9824-eaae58e1c458 tempest-VolumesTestJSON-31454246 None] Deleted volume successfully. Sep 28 18:06:02 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d1f8bae2-69f5-4d31-9824-eaae58e1c458 tempest-VolumesTestJSON-31454246 None] Lock "cinder-d23967d2-b540-4114-be7e-1fb66d05b9f2-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:02 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c1bd54c6-b648-474a-9585-7667ebb3fdad tempest-VolumesTestJSON-31454246 None] Acquiring lock "cinder-83b54023-4ef2-40b2-b7b7-c1530a558ee1-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:03 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c1bd54c6-b648-474a-9585-7667ebb3fdad tempest-VolumesTestJSON-31454246 None] Lock "cinder-83b54023-4ef2-40b2-b7b7-c1530a558ee1-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:03 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c1bd54c6-b648-474a-9585-7667ebb3fdad tempest-VolumesTestJSON-31454246 None] Acquiring lock "cinder-quobyte-83b54023-4ef2-40b2-b7b7-c1530a558ee1" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:03 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c1bd54c6-b648-474a-9585-7667ebb3fdad tempest-VolumesTestJSON-31454246 None] Lock "cinder-quobyte-83b54023-4ef2-40b2-b7b7-c1530a558ee1" acquired by "delete_volume" :: waited 0.026s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:03 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a13c5f-a367-4858-bc4d-004dbfefbf8c]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c1bd54c6-b648-474a-9585-7667ebb3fdad tempest-VolumesTestJSON-31454246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-83b54023-4ef2-40b2-b7b7-c1530a558ee1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:03 devstack sudo[91569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-83b54023-4ef2-40b2-b7b7-c1530a558ee1 Sep 28 18:06:03 devstack sudo[91569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:03 devstack sudo[91569]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c1bd54c6-b648-474a-9585-7667ebb3fdad tempest-VolumesTestJSON-31454246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-83b54023-4ef2-40b2-b7b7-c1530a558ee1" returned: 0 in 0.473s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c1bd54c6-b648-474a-9585-7667ebb3fdad tempest-VolumesTestJSON-31454246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-83b54023-4ef2-40b2-b7b7-c1530a558ee1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:03 devstack sudo[91574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-83b54023-4ef2-40b2-b7b7-c1530a558ee1 Sep 28 18:06:03 devstack sudo[91574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:03 devstack sudo[91574]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c1bd54c6-b648-474a-9585-7667ebb3fdad tempest-VolumesTestJSON-31454246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-83b54023-4ef2-40b2-b7b7-c1530a558ee1" returned: 0 in 0.327s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:03 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c1bd54c6-b648-474a-9585-7667ebb3fdad tempest-VolumesTestJSON-31454246 None] Lock "cinder-quobyte-83b54023-4ef2-40b2-b7b7-c1530a558ee1" released by "delete_volume" :: held 0.861s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:04 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-c1bd54c6-b648-474a-9585-7667ebb3fdad tempest-VolumesTestJSON-31454246 None] Created reservations ['e503d565-d53a-4e5b-9517-db55f1ba3c13', '2d986ce5-8b11-4e3d-921c-701cd04511e4', 'dd9909c6-73d2-4dc2-ab09-481fb51afd06', '9eb3b1b3-affd-4d2d-8360-d89810aea833'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c1bd54c6-b648-474a-9585-7667ebb3fdad tempest-VolumesTestJSON-31454246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c1bd54c6-b648-474a-9585-7667ebb3fdad tempest-VolumesTestJSON-31454246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c1bd54c6-b648-474a-9585-7667ebb3fdad tempest-VolumesTestJSON-31454246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c1bd54c6-b648-474a-9585-7667ebb3fdad tempest-VolumesTestJSON-31454246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c1bd54c6-b648-474a-9585-7667ebb3fdad tempest-VolumesTestJSON-31454246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c1bd54c6-b648-474a-9585-7667ebb3fdad tempest-VolumesTestJSON-31454246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-43d7786b-c919-48c5-8bd0-8290ab8afa7c tempest-VolumesTestJSON-31454246 None] Acquiring lock "cinder-e44bb51a-6e18-4196-9737-53520833678d-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:04 devstack sudo[91580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:06:04 devstack sudo[91580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-43d7786b-c919-48c5-8bd0-8290ab8afa7c tempest-VolumesTestJSON-31454246 None] Lock "cinder-e44bb51a-6e18-4196-9737-53520833678d-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-43d7786b-c919-48c5-8bd0-8290ab8afa7c tempest-VolumesTestJSON-31454246 None] Acquiring lock "cinder-quobyte-e44bb51a-6e18-4196-9737-53520833678d" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-43d7786b-c919-48c5-8bd0-8290ab8afa7c tempest-VolumesTestJSON-31454246 None] Lock "cinder-quobyte-e44bb51a-6e18-4196-9737-53520833678d" acquired by "delete_volume" :: waited 0.025s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:06:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:04 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9a4441-c091-4bc4-8915-520c0e5a34ac]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-43d7786b-c919-48c5-8bd0-8290ab8afa7c tempest-VolumesTestJSON-31454246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e44bb51a-6e18-4196-9737-53520833678d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:04 devstack sudo[91582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:06:04 devstack sudo[91582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:04 devstack sudo[91583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e44bb51a-6e18-4196-9737-53520833678d Sep 28 18:06:04 devstack sudo[91583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:04 devstack sudo[91580]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c1bd54c6-b648-474a-9585-7667ebb3fdad tempest-VolumesTestJSON-31454246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.472s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:04 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-c1bd54c6-b648-474a-9585-7667ebb3fdad tempest-VolumesTestJSON-31454246 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:06:04 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-c1bd54c6-b648-474a-9585-7667ebb3fdad tempest-VolumesTestJSON-31454246 None] Deleted volume successfully. Sep 28 18:06:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c1bd54c6-b648-474a-9585-7667ebb3fdad tempest-VolumesTestJSON-31454246 None] Lock "cinder-83b54023-4ef2-40b2-b7b7-c1530a558ee1-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:04 devstack sudo[91582]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.449s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:04 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:06:05 devstack sudo[91583]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-43d7786b-c919-48c5-8bd0-8290ab8afa7c tempest-VolumesTestJSON-31454246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e44bb51a-6e18-4196-9737-53520833678d" returned: 0 in 0.473s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-43d7786b-c919-48c5-8bd0-8290ab8afa7c tempest-VolumesTestJSON-31454246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e44bb51a-6e18-4196-9737-53520833678d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:05 devstack sudo[91596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e44bb51a-6e18-4196-9737-53520833678d Sep 28 18:06:05 devstack sudo[91596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:05 devstack sudo[91596]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-43d7786b-c919-48c5-8bd0-8290ab8afa7c tempest-VolumesTestJSON-31454246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e44bb51a-6e18-4196-9737-53520833678d" returned: 0 in 0.308s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-43d7786b-c919-48c5-8bd0-8290ab8afa7c tempest-VolumesTestJSON-31454246 None] Lock "cinder-quobyte-e44bb51a-6e18-4196-9737-53520833678d" released by "delete_volume" :: held 0.890s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:05 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-43d7786b-c919-48c5-8bd0-8290ab8afa7c tempest-VolumesTestJSON-31454246 None] Created reservations ['70a43721-e639-454d-95c1-b77d6d267734', '54a7d58b-1e5d-4085-9c4a-329061148d15', 'f518c4de-41ce-4659-9f40-e399b9816cf2', '13749ad6-c8fd-4a62-99a2-824b3d46a8eb'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-43d7786b-c919-48c5-8bd0-8290ab8afa7c tempest-VolumesTestJSON-31454246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-43d7786b-c919-48c5-8bd0-8290ab8afa7c tempest-VolumesTestJSON-31454246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-43d7786b-c919-48c5-8bd0-8290ab8afa7c tempest-VolumesTestJSON-31454246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-43d7786b-c919-48c5-8bd0-8290ab8afa7c tempest-VolumesTestJSON-31454246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-43d7786b-c919-48c5-8bd0-8290ab8afa7c tempest-VolumesTestJSON-31454246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-43d7786b-c919-48c5-8bd0-8290ab8afa7c tempest-VolumesTestJSON-31454246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:05 devstack sudo[91630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:06:05 devstack sudo[91630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:05 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-deb50e01-64c3-4710-88e7-692b60b46c91 req-d761b339-43e0-46df-95cf-aec060710c5b tempest-ServerActionsTestOtherA-1750096549 None] Terminate volume connection completed successfully. Sep 28 18:06:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-deb50e01-64c3-4710-88e7-692b60b46c91 req-d761b339-43e0-46df-95cf-aec060710c5b tempest-ServerActionsTestOtherA-1750096549 None] Deleting attachment e03de5f7-8ca7-4d93-8bb8-f35439555ab2. {{(pid=86980) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:06:05 devstack sudo[91630]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-43d7786b-c919-48c5-8bd0-8290ab8afa7c tempest-VolumesTestJSON-31454246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.304s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:05 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-43d7786b-c919-48c5-8bd0-8290ab8afa7c tempest-VolumesTestJSON-31454246 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:06:05 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-43d7786b-c919-48c5-8bd0-8290ab8afa7c tempest-VolumesTestJSON-31454246 None] Deleted volume successfully. Sep 28 18:06:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-43d7786b-c919-48c5-8bd0-8290ab8afa7c tempest-VolumesTestJSON-31454246 None] Lock "cinder-e44bb51a-6e18-4196-9737-53520833678d-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-deb50e01-64c3-4710-88e7-692b60b46c91 req-ed5659bc-b161-4d10-9cff-70d26181189a tempest-ServerActionsTestOtherA-1750096549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-deb50e01-64c3-4710-88e7-692b60b46c91 req-ed5659bc-b161-4d10-9cff-70d26181189a tempest-ServerActionsTestOtherA-1750096549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-deb50e01-64c3-4710-88e7-692b60b46c91 req-ed5659bc-b161-4d10-9cff-70d26181189a tempest-ServerActionsTestOtherA-1750096549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-deb50e01-64c3-4710-88e7-692b60b46c91 req-ed5659bc-b161-4d10-9cff-70d26181189a tempest-ServerActionsTestOtherA-1750096549 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729', 'name': 'volume-aa608ea7-6718-459b-b622-ed2567fe7654', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eac9ebe6-b9ed-4116-86af-80bbe5cadcb9', 'enforce_multipath': True} {{(pid=86980) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:06:06 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-deb50e01-64c3-4710-88e7-692b60b46c91 req-ed5659bc-b161-4d10-9cff-70d26181189a tempest-ServerActionsTestOtherA-1750096549 None] attachment_update completed successfully. Sep 28 18:06:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-9fc2f7a4-d208-4831-85ed-e706893cfb51 req-7b5da8a4-818e-4b90-8974-157de3f90319 tempest-TaggedAttachmentsTest-889441576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-9fc2f7a4-d208-4831-85ed-e706893cfb51 req-7b5da8a4-818e-4b90-8974-157de3f90319 tempest-TaggedAttachmentsTest-889441576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-9fc2f7a4-d208-4831-85ed-e706893cfb51 req-7b5da8a4-818e-4b90-8974-157de3f90319 tempest-TaggedAttachmentsTest-889441576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-9fc2f7a4-d208-4831-85ed-e706893cfb51 req-7b5da8a4-818e-4b90-8974-157de3f90319 tempest-TaggedAttachmentsTest-889441576 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729', 'name': 'volume-3c83ddfd-fd10-4e96-87ed-b783b06da62a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca0201fa-19af-4a68-9e6f-ddc0009eb22a', 'enforce_multipath': True} {{(pid=86980) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:06:18 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-9fc2f7a4-d208-4831-85ed-e706893cfb51 req-7b5da8a4-818e-4b90-8974-157de3f90319 tempest-TaggedAttachmentsTest-889441576 None] attachment_update completed successfully. Sep 28 18:06:21 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:06:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Flow 'volume_create_manager' (cea21e18-8a46-43b1-95fb-ed781fb6f0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b726841a-dd4d-4d42-89bb-3ad466d50327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b726841a-dd4d-4d42-89bb-3ad466d50327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2032630813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7f176af-8c3e-4797-96e1-05ae25f548d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c0102863a64f04ac4fa794839d5428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:21Z,use_quota=True,user_id='cd04b843b2894f23961b6f17180615b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2f8f17-ce63-4ca9-9bde-d385e9f7461b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2f8f17-ce63-4ca9-9bde-d385e9f7461b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9692f0fe-13fe-4897-8697-97c37b74172a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9692f0fe-13fe-4897-8697-97c37b74172a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7f176af-8c3e-4797-96e1-05ae25f548d4', 'volume_name': 'volume-b7f176af-8c3e-4797-96e1-05ae25f548d4', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a5ee3e0-4136-42e0-b1ab-244cbf5fbce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a5ee3e0-4136-42e0-b1ab-244cbf5fbce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2679d69c-2c80-4afc-aa50-3d18c081099d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:21 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Volume b7f176af-8c3e-4797-96e1-05ae25f548d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7f176af-8c3e-4797-96e1-05ae25f548d4', 'volume_size': 1} Sep 28 18:06:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:21 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2032630813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7f176af-8c3e-4797-96e1-05ae25f548d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c0102863a64f04ac4fa794839d5428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:21Z,use_quota=True,user_id='cd04b843b2894f23961b6f17180615b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:06:21 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Creating volume b7f176af-8c3e-4797-96e1-05ae25f548d4 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:06:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:21 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:21 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:21 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:06:21 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:06:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7f176af-8c3e-4797-96e1-05ae25f548d4 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:21 devstack sudo[92300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7f176af-8c3e-4797-96e1-05ae25f548d4 1073741824 Sep 28 18:06:21 devstack sudo[92300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:22 devstack sudo[92300]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7f176af-8c3e-4797-96e1-05ae25f548d4 1073741824" returned: 0 in 0.717s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7f176af-8c3e-4797-96e1-05ae25f548d4 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:22 devstack sudo[92307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7f176af-8c3e-4797-96e1-05ae25f548d4 Sep 28 18:06:22 devstack sudo[92307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:22 devstack sudo[92307]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7f176af-8c3e-4797-96e1-05ae25f548d4" returned: 0 in 0.364s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:22 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:06:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2679d69c-2c80-4afc-aa50-3d18c081099d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7f176af-8c3e-4797-96e1-05ae25f548d4', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f6cf25b-6972-4c4d-9e37-f3d3b4402a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:22 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Volume volume-b7f176af-8c3e-4797-96e1-05ae25f548d4 (b7f176af-8c3e-4797-96e1-05ae25f548d4): created successfully Sep 28 18:06:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f6cf25b-6972-4c4d-9e37-f3d3b4402a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Flow 'volume_create_manager' (cea21e18-8a46-43b1-95fb-ed781fb6f0b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:22 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-4d66daa7-076e-4296-8c54-41e90ad64de8 tempest-AttachVolumeTestJSON-144497230 None] Created volume successfully. Sep 28 18:06:22 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-8e0b2ce1-b0c9-439e-bb14-4ad52fb2b74a req-65213554-7c9e-4e07-a36d-0bc1d36fd851 tempest-TaggedAttachmentsTest-889441576 None] Terminate volume connection completed successfully. Sep 28 18:06:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-8e0b2ce1-b0c9-439e-bb14-4ad52fb2b74a req-65213554-7c9e-4e07-a36d-0bc1d36fd851 tempest-TaggedAttachmentsTest-889441576 None] Deleting attachment ca0201fa-19af-4a68-9e6f-ddc0009eb22a. {{(pid=86980) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:06:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-2a11b2ae-ba40-4c40-9656-7ca9d1758c62 req-12826eba-71f0-4f1a-8729-750ae31a01fb tempest-AttachVolumeTestJSON-144497230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-2a11b2ae-ba40-4c40-9656-7ca9d1758c62 req-12826eba-71f0-4f1a-8729-750ae31a01fb tempest-AttachVolumeTestJSON-144497230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-2a11b2ae-ba40-4c40-9656-7ca9d1758c62 req-12826eba-71f0-4f1a-8729-750ae31a01fb tempest-AttachVolumeTestJSON-144497230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-2a11b2ae-ba40-4c40-9656-7ca9d1758c62 req-12826eba-71f0-4f1a-8729-750ae31a01fb tempest-AttachVolumeTestJSON-144497230 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729', 'name': 'volume-b7f176af-8c3e-4797-96e1-05ae25f548d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f95db9b3-acfe-4a95-878d-a1303f79b0b8', 'enforce_multipath': True} {{(pid=86980) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:06:25 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-2a11b2ae-ba40-4c40-9656-7ca9d1758c62 req-12826eba-71f0-4f1a-8729-750ae31a01fb tempest-AttachVolumeTestJSON-144497230 None] attachment_update completed successfully. Sep 28 18:06:28 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:06:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Flow 'volume_create_manager' (dc6501aa-b751-4a7e-9917-fef39731ea4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac3f603-5b35-4b5a-a217-ccb0a42fb2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac3f603-5b35-4b5a-a217-ccb0a42fb2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1028390851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e8f0ecf-427e-4faf-b469-3629ce200c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c0102863a64f04ac4fa794839d5428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:28Z,use_quota=True,user_id='cd04b843b2894f23961b6f17180615b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1053d16d-c4bd-4f8a-a905-1236ee5cb9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1053d16d-c4bd-4f8a-a905-1236ee5cb9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877831a6-a4bf-4920-99da-bc7875d56dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (877831a6-a4bf-4920-99da-bc7875d56dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e8f0ecf-427e-4faf-b469-3629ce200c86', 'volume_name': 'volume-2e8f0ecf-427e-4faf-b469-3629ce200c86', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c61faa2d-ce2e-40e5-8eb7-8f6ab7bf9245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c61faa2d-ce2e-40e5-8eb7-8f6ab7bf9245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bac7eee-1523-4eab-9b88-b285f4c68cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:28 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Volume 2e8f0ecf-427e-4faf-b469-3629ce200c86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e8f0ecf-427e-4faf-b469-3629ce200c86', 'volume_size': 1} Sep 28 18:06:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:28 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1028390851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e8f0ecf-427e-4faf-b469-3629ce200c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c0102863a64f04ac4fa794839d5428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:28Z,use_quota=True,user_id='cd04b843b2894f23961b6f17180615b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:06:28 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Creating volume 2e8f0ecf-427e-4faf-b469-3629ce200c86 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:06:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:28 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:28 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:28 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:06:28 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:06:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2e8f0ecf-427e-4faf-b469-3629ce200c86 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:28 devstack sudo[92417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2e8f0ecf-427e-4faf-b469-3629ce200c86 1073741824 Sep 28 18:06:28 devstack sudo[92417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:29 devstack sudo[92417]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2e8f0ecf-427e-4faf-b469-3629ce200c86 1073741824" returned: 0 in 0.620s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2e8f0ecf-427e-4faf-b469-3629ce200c86 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:29 devstack sudo[92433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2e8f0ecf-427e-4faf-b469-3629ce200c86 Sep 28 18:06:29 devstack sudo[92433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:29 devstack sudo[92433]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2e8f0ecf-427e-4faf-b469-3629ce200c86" returned: 0 in 0.422s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:06:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bac7eee-1523-4eab-9b88-b285f4c68cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e8f0ecf-427e-4faf-b469-3629ce200c86', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (217a19d2-562a-4c19-8842-3d7998220936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:29 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Volume volume-2e8f0ecf-427e-4faf-b469-3629ce200c86 (2e8f0ecf-427e-4faf-b469-3629ce200c86): created successfully Sep 28 18:06:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (217a19d2-562a-4c19-8842-3d7998220936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Flow 'volume_create_manager' (dc6501aa-b751-4a7e-9917-fef39731ea4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:29 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-1d3936b7-d139-4175-bff9-12af733415f6 tempest-AttachVolumeTestJSON-144497230 None] Created volume successfully. Sep 28 18:06:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-f454de8d-4057-4a3f-8e35-aeb395cbe7fb req-772d82ee-7357-4884-b8fd-0282d6cbc6af tempest-AttachVolumeTestJSON-144497230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-f454de8d-4057-4a3f-8e35-aeb395cbe7fb req-772d82ee-7357-4884-b8fd-0282d6cbc6af tempest-AttachVolumeTestJSON-144497230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-f454de8d-4057-4a3f-8e35-aeb395cbe7fb req-772d82ee-7357-4884-b8fd-0282d6cbc6af tempest-AttachVolumeTestJSON-144497230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-f454de8d-4057-4a3f-8e35-aeb395cbe7fb req-772d82ee-7357-4884-b8fd-0282d6cbc6af tempest-AttachVolumeTestJSON-144497230 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729', 'name': 'volume-2e8f0ecf-427e-4faf-b469-3629ce200c86', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e0cb9e46-cd1b-49d7-a0b6-b5d4e87a8afd', 'enforce_multipath': True} {{(pid=86980) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:06:31 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-f454de8d-4057-4a3f-8e35-aeb395cbe7fb req-772d82ee-7357-4884-b8fd-0282d6cbc6af tempest-AttachVolumeTestJSON-144497230 None] attachment_update completed successfully. Sep 28 18:06:34 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-687a96dd-0ee6-40eb-9616-febca073ec54 tempest-TaggedAttachmentsTest-889441576 None] Acquiring lock "cinder-3c83ddfd-fd10-4e96-87ed-b783b06da62a-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:34 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-3683ab7e-a449-4a9a-a2a3-3119e071b994 req-0411b908-1c9c-477b-87a9-0fbb7d354ebd tempest-AttachVolumeTestJSON-144497230 None] Terminate volume connection completed successfully. Sep 28 18:06:34 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-3683ab7e-a449-4a9a-a2a3-3119e071b994 req-0411b908-1c9c-477b-87a9-0fbb7d354ebd tempest-AttachVolumeTestJSON-144497230 None] Deleting attachment f95db9b3-acfe-4a95-878d-a1303f79b0b8. {{(pid=86980) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:06:34 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-687a96dd-0ee6-40eb-9616-febca073ec54 tempest-TaggedAttachmentsTest-889441576 None] Lock "cinder-3c83ddfd-fd10-4e96-87ed-b783b06da62a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:34 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-687a96dd-0ee6-40eb-9616-febca073ec54 tempest-TaggedAttachmentsTest-889441576 None] Acquiring lock "cinder-quobyte-3c83ddfd-fd10-4e96-87ed-b783b06da62a" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:35 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-687a96dd-0ee6-40eb-9616-febca073ec54 tempest-TaggedAttachmentsTest-889441576 None] Lock "cinder-quobyte-3c83ddfd-fd10-4e96-87ed-b783b06da62a" acquired by "delete_volume" :: waited 0.024s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:35 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13030f3-43e7-4d39-9ccf-8289b43af5c3]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-687a96dd-0ee6-40eb-9616-febca073ec54 tempest-TaggedAttachmentsTest-889441576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3c83ddfd-fd10-4e96-87ed-b783b06da62a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:35 devstack sudo[92487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3c83ddfd-fd10-4e96-87ed-b783b06da62a Sep 28 18:06:35 devstack sudo[92487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:35 devstack sudo[92487]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-687a96dd-0ee6-40eb-9616-febca073ec54 tempest-TaggedAttachmentsTest-889441576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3c83ddfd-fd10-4e96-87ed-b783b06da62a" returned: 0 in 0.570s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-687a96dd-0ee6-40eb-9616-febca073ec54 tempest-TaggedAttachmentsTest-889441576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3c83ddfd-fd10-4e96-87ed-b783b06da62a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:35 devstack sudo[92493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3c83ddfd-fd10-4e96-87ed-b783b06da62a Sep 28 18:06:35 devstack sudo[92493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:36 devstack sudo[92493]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-687a96dd-0ee6-40eb-9616-febca073ec54 tempest-TaggedAttachmentsTest-889441576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3c83ddfd-fd10-4e96-87ed-b783b06da62a" returned: 0 in 0.390s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:36 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-687a96dd-0ee6-40eb-9616-febca073ec54 tempest-TaggedAttachmentsTest-889441576 None] Lock "cinder-quobyte-3c83ddfd-fd10-4e96-87ed-b783b06da62a" released by "delete_volume" :: held 1.040s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:36 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=66,cinder:UPDATE=62,cinder:INSERT=10,cinder:DELETE=4 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:06:36 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=74,cinder:UPDATE=55,cinder:DELETE=6,cinder:INSERT=12 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:06:36 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-687a96dd-0ee6-40eb-9616-febca073ec54 tempest-TaggedAttachmentsTest-889441576 None] Created reservations ['9ba6bba6-a985-448b-84a8-e416a2463cbe', '444429d5-8747-4f7c-ae7c-c6b66298b007', '81daae2b-76ff-4395-a8b2-fb548ffbd88b', 'c08f948a-ee81-45c6-826a-a43bbba86bd9'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-687a96dd-0ee6-40eb-9616-febca073ec54 tempest-TaggedAttachmentsTest-889441576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-687a96dd-0ee6-40eb-9616-febca073ec54 tempest-TaggedAttachmentsTest-889441576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-687a96dd-0ee6-40eb-9616-febca073ec54 tempest-TaggedAttachmentsTest-889441576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-687a96dd-0ee6-40eb-9616-febca073ec54 tempest-TaggedAttachmentsTest-889441576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-687a96dd-0ee6-40eb-9616-febca073ec54 tempest-TaggedAttachmentsTest-889441576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-687a96dd-0ee6-40eb-9616-febca073ec54 tempest-TaggedAttachmentsTest-889441576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:36 devstack sudo[92499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:06:36 devstack sudo[92499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:36 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-d32e0f0d-dda6-4a82-ad22-36f1a1c79437 req-d338a8d6-8703-44b7-a59a-4022b95301a1 tempest-AttachVolumeTestJSON-144497230 None] Terminate volume connection completed successfully. Sep 28 18:06:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-d32e0f0d-dda6-4a82-ad22-36f1a1c79437 req-d338a8d6-8703-44b7-a59a-4022b95301a1 tempest-AttachVolumeTestJSON-144497230 None] Deleting attachment e0cb9e46-cd1b-49d7-a0b6-b5d4e87a8afd. {{(pid=86980) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:06:36 devstack sudo[92499]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-687a96dd-0ee6-40eb-9616-febca073ec54 tempest-TaggedAttachmentsTest-889441576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.334s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:36 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-687a96dd-0ee6-40eb-9616-febca073ec54 tempest-TaggedAttachmentsTest-889441576 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:06:36 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-687a96dd-0ee6-40eb-9616-febca073ec54 tempest-TaggedAttachmentsTest-889441576 None] Deleted volume successfully. Sep 28 18:06:36 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-687a96dd-0ee6-40eb-9616-febca073ec54 tempest-TaggedAttachmentsTest-889441576 None] Lock "cinder-3c83ddfd-fd10-4e96-87ed-b783b06da62a-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:37 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:06:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Flow 'volume_create_manager' (f2191a8f-e413-4ea2-b57d-84ae2a86f179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c07b32-094c-4706-91ce-4bce58cb6541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c07b32-094c-4706-91ce-4bce58cb6541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-868516623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=190ad25c-e138-4140-b5ff-db156e59fc6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f2ed134712b403da31ac67e6c5595a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:37Z,use_quota=True,user_id='ab0ed5be43684cfb92f04349f35796c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc65450-deda-4238-ab9d-b3f8855e7027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dc65450-deda-4238-ab9d-b3f8855e7027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3320c124-3e7c-4054-8dd3-0f34629ee67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3320c124-3e7c-4054-8dd3-0f34629ee67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '190ad25c-e138-4140-b5ff-db156e59fc6d', 'volume_name': 'volume-190ad25c-e138-4140-b5ff-db156e59fc6d', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06113887-b21b-4bde-ac30-4f70567bf6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06113887-b21b-4bde-ac30-4f70567bf6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123ba16c-0581-4c9a-93f3-234629d04f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:37 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Volume 190ad25c-e138-4140-b5ff-db156e59fc6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-190ad25c-e138-4140-b5ff-db156e59fc6d', 'volume_size': 1} Sep 28 18:06:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-868516623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=190ad25c-e138-4140-b5ff-db156e59fc6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f2ed134712b403da31ac67e6c5595a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:06:37Z,use_quota=True,user_id='ab0ed5be43684cfb92f04349f35796c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:06:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Creating volume 190ad25c-e138-4140-b5ff-db156e59fc6d {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:06:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:06:37 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:06:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:37 devstack sudo[92504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d 1073741824 Sep 28 18:06:37 devstack sudo[92504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:38 devstack sudo[92504]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d 1073741824" returned: 0 in 0.772s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:38 devstack sudo[92533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d Sep 28 18:06:38 devstack sudo[92533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:38 devstack sudo[92533]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d" returned: 0 in 0.327s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:06:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123ba16c-0581-4c9a-93f3-234629d04f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-190ad25c-e138-4140-b5ff-db156e59fc6d', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1455f92f-914f-4bea-a4d7-4cf4632f9408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:06:38 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Volume volume-190ad25c-e138-4140-b5ff-db156e59fc6d (190ad25c-e138-4140-b5ff-db156e59fc6d): created successfully Sep 28 18:06:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1455f92f-914f-4bea-a4d7-4cf4632f9408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:06:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Flow 'volume_create_manager' (f2191a8f-e413-4ea2-b57d-84ae2a86f179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:06:38 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-22f69abd-6cd6-4f77-b31d-bc844cbc6da9 tempest-SnapshotsActionsTest-1278071978 None] Created volume successfully. Sep 28 18:06:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0da29b2f-cd0b-44c4-a6ba-3b022f92a87e tempest-SnapshotsActionsTest-1278071978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0da29b2f-cd0b-44c4-a6ba-3b022f92a87e tempest-SnapshotsActionsTest-1278071978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-0da29b2f-cd0b-44c4-a6ba-3b022f92a87e tempest-SnapshotsActionsTest-1278071978 None] Creating offline snapshot 1a76e5d0-7875-4865-8ef0-c679a5a6b708 of volume 190ad25c-e138-4140-b5ff-db156e59fc6d {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:06:39 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a605a9b-6827-4724-bda0-82478265f51a]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0da29b2f-cd0b-44c4-a6ba-3b022f92a87e tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:39 devstack sudo[92542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d Sep 28 18:06:39 devstack sudo[92542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:40 devstack sudo[92542]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0da29b2f-cd0b-44c4-a6ba-3b022f92a87e tempest-SnapshotsActionsTest-1278071978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d" returned: 0 in 0.447s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0da29b2f-cd0b-44c4-a6ba-3b022f92a87e tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:40 devstack sudo[92547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 1G Sep 28 18:06:40 devstack sudo[92547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:40 devstack sudo[92547]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0da29b2f-cd0b-44c4-a6ba-3b022f92a87e tempest-SnapshotsActionsTest-1278071978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 1G" returned: 0 in 0.667s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0da29b2f-cd0b-44c4-a6ba-3b022f92a87e tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-190ad25c-e138-4140-b5ff-db156e59fc6d -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:40 devstack sudo[92555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-190ad25c-e138-4140-b5ff-db156e59fc6d -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 Sep 28 18:06:40 devstack sudo[92555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:41 devstack sudo[92555]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0da29b2f-cd0b-44c4-a6ba-3b022f92a87e tempest-SnapshotsActionsTest-1278071978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-190ad25c-e138-4140-b5ff-db156e59fc6d -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708" returned: 0 in 0.434s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:41 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-0da29b2f-cd0b-44c4-a6ba-3b022f92a87e tempest-SnapshotsActionsTest-1278071978 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 is being set with open permissions: ugo+rw Sep 28 18:06:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0da29b2f-cd0b-44c4-a6ba-3b022f92a87e tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:41 devstack sudo[92561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 Sep 28 18:06:41 devstack sudo[92561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:41 devstack sudo[92561]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0da29b2f-cd0b-44c4-a6ba-3b022f92a87e tempest-SnapshotsActionsTest-1278071978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708" returned: 0 in 0.275s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0da29b2f-cd0b-44c4-a6ba-3b022f92a87e tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:41 devstack sudo[92564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.info Sep 28 18:06:41 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:41 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0da29b2f-cd0b-44c4-a6ba-3b022f92a87e tempest-SnapshotsActionsTest-1278071978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.info" returned: 0 in 0.277s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:41 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-0da29b2f-cd0b-44c4-a6ba-3b022f92a87e tempest-SnapshotsActionsTest-1278071978 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.info is being set with open permissions: ugo+rw Sep 28 18:06:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0da29b2f-cd0b-44c4-a6ba-3b022f92a87e tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:41 devstack sudo[92567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.info Sep 28 18:06:41 devstack sudo[92567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:42 devstack sudo[92567]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0da29b2f-cd0b-44c4-a6ba-3b022f92a87e tempest-SnapshotsActionsTest-1278071978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.info" returned: 0 in 0.363s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0da29b2f-cd0b-44c4-a6ba-3b022f92a87e tempest-SnapshotsActionsTest-1278071978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.593s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:42 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-0da29b2f-cd0b-44c4-a6ba-3b022f92a87e tempest-SnapshotsActionsTest-1278071978 None] Create snapshot completed successfully Sep 28 18:06:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-565beebc-be41-40b1-aa1b-94aecb9f661b tempest-AttachVolumeTestJSON-144497230 None] Acquiring lock "cinder-2e8f0ecf-427e-4faf-b469-3629ce200c86-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-565beebc-be41-40b1-aa1b-94aecb9f661b tempest-AttachVolumeTestJSON-144497230 None] Lock "cinder-2e8f0ecf-427e-4faf-b469-3629ce200c86-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-565beebc-be41-40b1-aa1b-94aecb9f661b tempest-AttachVolumeTestJSON-144497230 None] Acquiring lock "cinder-quobyte-2e8f0ecf-427e-4faf-b469-3629ce200c86" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-565beebc-be41-40b1-aa1b-94aecb9f661b tempest-AttachVolumeTestJSON-144497230 None] Lock "cinder-quobyte-2e8f0ecf-427e-4faf-b469-3629ce200c86" acquired by "delete_volume" :: waited 0.020s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:43 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[07faa24f-809c-4425-88ed-f8c052f97327]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-565beebc-be41-40b1-aa1b-94aecb9f661b tempest-AttachVolumeTestJSON-144497230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2e8f0ecf-427e-4faf-b469-3629ce200c86 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:43 devstack sudo[92571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2e8f0ecf-427e-4faf-b469-3629ce200c86 Sep 28 18:06:43 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b0a27ff7-307f-429f-aabd-559bae76c461 tempest-SnapshotsActionsTest-1278071978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b0a27ff7-307f-429f-aabd-559bae76c461 tempest-SnapshotsActionsTest-1278071978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-b0a27ff7-307f-429f-aabd-559bae76c461 tempest-SnapshotsActionsTest-1278071978 None] Creating offline snapshot d84e6b17-fb5c-41fa-979c-00d01fa6d604 of volume 190ad25c-e138-4140-b5ff-db156e59fc6d {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:06:43 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-565beebc-be41-40b1-aa1b-94aecb9f661b tempest-AttachVolumeTestJSON-144497230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2e8f0ecf-427e-4faf-b469-3629ce200c86" returned: 0 in 0.600s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-565beebc-be41-40b1-aa1b-94aecb9f661b tempest-AttachVolumeTestJSON-144497230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2e8f0ecf-427e-4faf-b469-3629ce200c86 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:43 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3041f42-6474-4a6f-8997-ea259a712d59]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b0a27ff7-307f-429f-aabd-559bae76c461 tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:43 devstack sudo[92577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2e8f0ecf-427e-4faf-b469-3629ce200c86 Sep 28 18:06:43 devstack sudo[92577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:43 devstack sudo[92578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 Sep 28 18:06:43 devstack sudo[92578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:44 devstack sudo[92577]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-565beebc-be41-40b1-aa1b-94aecb9f661b tempest-AttachVolumeTestJSON-144497230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2e8f0ecf-427e-4faf-b469-3629ce200c86" returned: 0 in 0.300s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:44 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-565beebc-be41-40b1-aa1b-94aecb9f661b tempest-AttachVolumeTestJSON-144497230 None] Lock "cinder-quobyte-2e8f0ecf-427e-4faf-b469-3629ce200c86" released by "delete_volume" :: held 0.954s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:44 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-565beebc-be41-40b1-aa1b-94aecb9f661b tempest-AttachVolumeTestJSON-144497230 None] Created reservations ['6af5af61-ce6f-44b4-9ff9-af2933518082', 'e08a9d9b-51a5-48a2-b3eb-c1809ae5abe7', '9ecc7dcb-16df-4661-a8d3-c3c940adb1b7', 'bd98a303-1b9b-4721-a32f-a050945c1b59'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:44 devstack sudo[92578]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b0a27ff7-307f-429f-aabd-559bae76c461 tempest-SnapshotsActionsTest-1278071978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708" returned: 0 in 0.472s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:44 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-b0a27ff7-307f-429f-aabd-559bae76c461 tempest-SnapshotsActionsTest-1278071978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-190ad25c-e138-4140-b5ff-db156e59fc6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:06:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b0a27ff7-307f-429f-aabd-559bae76c461 tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.d84e6b17-fb5c-41fa-979c-00d01fa6d604 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-565beebc-be41-40b1-aa1b-94aecb9f661b tempest-AttachVolumeTestJSON-144497230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-565beebc-be41-40b1-aa1b-94aecb9f661b tempest-AttachVolumeTestJSON-144497230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:44 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-565beebc-be41-40b1-aa1b-94aecb9f661b tempest-AttachVolumeTestJSON-144497230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:44 devstack sudo[92601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.d84e6b17-fb5c-41fa-979c-00d01fa6d604 1G Sep 28 18:06:44 devstack sudo[92601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:44 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-565beebc-be41-40b1-aa1b-94aecb9f661b tempest-AttachVolumeTestJSON-144497230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-565beebc-be41-40b1-aa1b-94aecb9f661b tempest-AttachVolumeTestJSON-144497230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-565beebc-be41-40b1-aa1b-94aecb9f661b tempest-AttachVolumeTestJSON-144497230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:44 devstack sudo[92622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:06:44 devstack sudo[92622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:44 devstack sudo[92622]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-565beebc-be41-40b1-aa1b-94aecb9f661b tempest-AttachVolumeTestJSON-144497230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.312s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:44 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-565beebc-be41-40b1-aa1b-94aecb9f661b tempest-AttachVolumeTestJSON-144497230 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:06:44 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-565beebc-be41-40b1-aa1b-94aecb9f661b tempest-AttachVolumeTestJSON-144497230 None] Deleted volume successfully. Sep 28 18:06:44 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-565beebc-be41-40b1-aa1b-94aecb9f661b tempest-AttachVolumeTestJSON-144497230 None] Lock "cinder-2e8f0ecf-427e-4faf-b469-3629ce200c86-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:44 devstack sudo[92601]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b0a27ff7-307f-429f-aabd-559bae76c461 tempest-SnapshotsActionsTest-1278071978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.d84e6b17-fb5c-41fa-979c-00d01fa6d604 1G" returned: 0 in 0.621s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b0a27ff7-307f-429f-aabd-559bae76c461 tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.d84e6b17-fb5c-41fa-979c-00d01fa6d604 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:44 devstack sudo[92632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.d84e6b17-fb5c-41fa-979c-00d01fa6d604 Sep 28 18:06:44 devstack sudo[92632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:45 devstack sudo[92632]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b0a27ff7-307f-429f-aabd-559bae76c461 tempest-SnapshotsActionsTest-1278071978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.d84e6b17-fb5c-41fa-979c-00d01fa6d604" returned: 0 in 0.306s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:45 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-b0a27ff7-307f-429f-aabd-559bae76c461 tempest-SnapshotsActionsTest-1278071978 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.d84e6b17-fb5c-41fa-979c-00d01fa6d604 is being set with open permissions: ugo+rw Sep 28 18:06:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b0a27ff7-307f-429f-aabd-559bae76c461 tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.d84e6b17-fb5c-41fa-979c-00d01fa6d604 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:45 devstack sudo[92637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.d84e6b17-fb5c-41fa-979c-00d01fa6d604 Sep 28 18:06:45 devstack sudo[92637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:45 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-362e887b-8723-4e24-aa54-7ffd509bde62 tempest-AttachVolumeTestJSON-144497230 None] Acquiring lock "cinder-b7f176af-8c3e-4797-96e1-05ae25f548d4-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:45 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-362e887b-8723-4e24-aa54-7ffd509bde62 tempest-AttachVolumeTestJSON-144497230 None] Lock "cinder-b7f176af-8c3e-4797-96e1-05ae25f548d4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:45 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-362e887b-8723-4e24-aa54-7ffd509bde62 tempest-AttachVolumeTestJSON-144497230 None] Acquiring lock "cinder-quobyte-b7f176af-8c3e-4797-96e1-05ae25f548d4" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:45 devstack sudo[92637]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:45 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-362e887b-8723-4e24-aa54-7ffd509bde62 tempest-AttachVolumeTestJSON-144497230 None] Lock "cinder-quobyte-b7f176af-8c3e-4797-96e1-05ae25f548d4" acquired by "delete_volume" :: waited 0.017s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b0a27ff7-307f-429f-aabd-559bae76c461 tempest-SnapshotsActionsTest-1278071978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.d84e6b17-fb5c-41fa-979c-00d01fa6d604" returned: 0 in 0.326s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b0a27ff7-307f-429f-aabd-559bae76c461 tempest-SnapshotsActionsTest-1278071978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.874s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:45 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fed283-394f-476e-9820-69adb75e52b2]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-362e887b-8723-4e24-aa54-7ffd509bde62 tempest-AttachVolumeTestJSON-144497230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7f176af-8c3e-4797-96e1-05ae25f548d4 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:45 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-b0a27ff7-307f-429f-aabd-559bae76c461 tempest-SnapshotsActionsTest-1278071978 None] Create snapshot completed successfully Sep 28 18:06:45 devstack sudo[92643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7f176af-8c3e-4797-96e1-05ae25f548d4 Sep 28 18:06:45 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:46 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-362e887b-8723-4e24-aa54-7ffd509bde62 tempest-AttachVolumeTestJSON-144497230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7f176af-8c3e-4797-96e1-05ae25f548d4" returned: 0 in 0.443s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-362e887b-8723-4e24-aa54-7ffd509bde62 tempest-AttachVolumeTestJSON-144497230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7f176af-8c3e-4797-96e1-05ae25f548d4 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:46 devstack sudo[92648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7f176af-8c3e-4797-96e1-05ae25f548d4 Sep 28 18:06:46 devstack sudo[92648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:46 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cd00e2a5-8d82-4392-9e54-97c770d6e190 tempest-SnapshotsActionsTest-763119705 None] Acquiring lock "cinder-d84e6b17-fb5c-41fa-979c-00d01fa6d604-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:46 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cd00e2a5-8d82-4392-9e54-97c770d6e190 tempest-SnapshotsActionsTest-763119705 None] Lock "cinder-d84e6b17-fb5c-41fa-979c-00d01fa6d604-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:46 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cd00e2a5-8d82-4392-9e54-97c770d6e190 tempest-SnapshotsActionsTest-763119705 None] Acquiring lock "cinder-quobyte-190ad25c-e138-4140-b5ff-db156e59fc6d" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:46 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cd00e2a5-8d82-4392-9e54-97c770d6e190 tempest-SnapshotsActionsTest-763119705 None] Lock "cinder-quobyte-190ad25c-e138-4140-b5ff-db156e59fc6d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:46 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cd00e2a5-8d82-4392-9e54-97c770d6e190 tempest-SnapshotsActionsTest-763119705 None] Acquiring lock "cinder-quobyte-d84e6b17-fb5c-41fa-979c-00d01fa6d604" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:46 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cd00e2a5-8d82-4392-9e54-97c770d6e190 tempest-SnapshotsActionsTest-763119705 None] Lock "cinder-quobyte-d84e6b17-fb5c-41fa-979c-00d01fa6d604" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:46 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-cd00e2a5-8d82-4392-9e54-97c770d6e190 tempest-SnapshotsActionsTest-763119705 None] Deleting offline snapshot d84e6b17-fb5c-41fa-979c-00d01fa6d604 of volume 190ad25c-e138-4140-b5ff-db156e59fc6d {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:06:46 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-cd00e2a5-8d82-4392-9e54-97c770d6e190 tempest-SnapshotsActionsTest-763119705 None] snapshot_file for this snap is: volume-190ad25c-e138-4140-b5ff-db156e59fc6d.d84e6b17-fb5c-41fa-979c-00d01fa6d604 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:06:46 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a0f0be-cff7-41a7-9904-2a0e243b358f]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cd00e2a5-8d82-4392-9e54-97c770d6e190 tempest-SnapshotsActionsTest-763119705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.d84e6b17-fb5c-41fa-979c-00d01fa6d604 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:46 devstack sudo[92650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.d84e6b17-fb5c-41fa-979c-00d01fa6d604 Sep 28 18:06:46 devstack sudo[92650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:46 devstack sudo[92648]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-362e887b-8723-4e24-aa54-7ffd509bde62 tempest-AttachVolumeTestJSON-144497230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7f176af-8c3e-4797-96e1-05ae25f548d4" returned: 0 in 0.354s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:46 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-362e887b-8723-4e24-aa54-7ffd509bde62 tempest-AttachVolumeTestJSON-144497230 None] Lock "cinder-quobyte-b7f176af-8c3e-4797-96e1-05ae25f548d4" released by "delete_volume" :: held 0.892s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:46 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-362e887b-8723-4e24-aa54-7ffd509bde62 tempest-AttachVolumeTestJSON-144497230 None] Created reservations ['c72ca684-54bb-4e41-8032-3f1885c1748b', 'e53b3547-afae-428d-9547-9073de88a029', 'ea16402a-1b6d-4b94-b9bc-a70f944d6e06', '3fbdc68e-a837-4adb-bb86-43202acae758'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-362e887b-8723-4e24-aa54-7ffd509bde62 tempest-AttachVolumeTestJSON-144497230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-362e887b-8723-4e24-aa54-7ffd509bde62 tempest-AttachVolumeTestJSON-144497230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:46 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-362e887b-8723-4e24-aa54-7ffd509bde62 tempest-AttachVolumeTestJSON-144497230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:46 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-362e887b-8723-4e24-aa54-7ffd509bde62 tempest-AttachVolumeTestJSON-144497230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-362e887b-8723-4e24-aa54-7ffd509bde62 tempest-AttachVolumeTestJSON-144497230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-362e887b-8723-4e24-aa54-7ffd509bde62 tempest-AttachVolumeTestJSON-144497230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:46 devstack sudo[92655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:06:46 devstack sudo[92655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:46 devstack sudo[92650]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cd00e2a5-8d82-4392-9e54-97c770d6e190 tempest-SnapshotsActionsTest-763119705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.d84e6b17-fb5c-41fa-979c-00d01fa6d604" returned: 0 in 0.532s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:46 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-cd00e2a5-8d82-4392-9e54-97c770d6e190 tempest-SnapshotsActionsTest-763119705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-190ad25c-e138-4140-b5ff-db156e59fc6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:06:46 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88f0751-c4a3-44a5-9d08-520a4075bac1]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cd00e2a5-8d82-4392-9e54-97c770d6e190 tempest-SnapshotsActionsTest-763119705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:46 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cab2941e-dfca-4393-b426-61f05d9b7cd9 tempest-AttachVolumeTestJSON-144497230 None] Acquiring lock "cinder-9b836b7b-31b8-48a5-b61e-566f741deee5-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:46 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cab2941e-dfca-4393-b426-61f05d9b7cd9 tempest-AttachVolumeTestJSON-144497230 None] Lock "cinder-9b836b7b-31b8-48a5-b61e-566f741deee5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:46 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cab2941e-dfca-4393-b426-61f05d9b7cd9 tempest-AttachVolumeTestJSON-144497230 None] Acquiring lock "cinder-quobyte-9b836b7b-31b8-48a5-b61e-566f741deee5" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:46 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cab2941e-dfca-4393-b426-61f05d9b7cd9 tempest-AttachVolumeTestJSON-144497230 None] Lock "cinder-quobyte-9b836b7b-31b8-48a5-b61e-566f741deee5" acquired by "delete_volume" :: waited 0.028s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:46 devstack sudo[92658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 Sep 28 18:06:46 devstack sudo[92658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:47 devstack sudo[92655]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-362e887b-8723-4e24-aa54-7ffd509bde62 tempest-AttachVolumeTestJSON-144497230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.432s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:47 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-362e887b-8723-4e24-aa54-7ffd509bde62 tempest-AttachVolumeTestJSON-144497230 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:06:47 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-362e887b-8723-4e24-aa54-7ffd509bde62 tempest-AttachVolumeTestJSON-144497230 None] Deleted volume successfully. Sep 28 18:06:47 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d087fd5-f469-4ba2-ac4e-0d2073d359c4]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cab2941e-dfca-4393-b426-61f05d9b7cd9 tempest-AttachVolumeTestJSON-144497230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b836b7b-31b8-48a5-b61e-566f741deee5 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-362e887b-8723-4e24-aa54-7ffd509bde62 tempest-AttachVolumeTestJSON-144497230 None] Lock "cinder-b7f176af-8c3e-4797-96e1-05ae25f548d4-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:47 devstack sudo[92661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b836b7b-31b8-48a5-b61e-566f741deee5 Sep 28 18:06:47 devstack sudo[92661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:47 devstack sudo[92658]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cd00e2a5-8d82-4392-9e54-97c770d6e190 tempest-SnapshotsActionsTest-763119705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708" returned: 0 in 0.576s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:47 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-cd00e2a5-8d82-4392-9e54-97c770d6e190 tempest-SnapshotsActionsTest-763119705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-190ad25c-e138-4140-b5ff-db156e59fc6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:06:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cd00e2a5-8d82-4392-9e54-97c770d6e190 tempest-SnapshotsActionsTest-763119705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.d84e6b17-fb5c-41fa-979c-00d01fa6d604 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:47 devstack sudo[92666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.d84e6b17-fb5c-41fa-979c-00d01fa6d604 Sep 28 18:06:47 devstack sudo[92666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:47 devstack sudo[92661]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cab2941e-dfca-4393-b426-61f05d9b7cd9 tempest-AttachVolumeTestJSON-144497230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b836b7b-31b8-48a5-b61e-566f741deee5" returned: 0 in 0.448s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cab2941e-dfca-4393-b426-61f05d9b7cd9 tempest-AttachVolumeTestJSON-144497230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b836b7b-31b8-48a5-b61e-566f741deee5 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:47 devstack sudo[92671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b836b7b-31b8-48a5-b61e-566f741deee5 Sep 28 18:06:47 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:47 devstack sudo[92666]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cd00e2a5-8d82-4392-9e54-97c770d6e190 tempest-SnapshotsActionsTest-763119705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.d84e6b17-fb5c-41fa-979c-00d01fa6d604" returned: 0 in 0.435s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cd00e2a5-8d82-4392-9e54-97c770d6e190 tempest-SnapshotsActionsTest-763119705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.d84e6b17-fb5c-41fa-979c-00d01fa6d604 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:47 devstack sudo[92677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.d84e6b17-fb5c-41fa-979c-00d01fa6d604 Sep 28 18:06:47 devstack sudo[92677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:47 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cab2941e-dfca-4393-b426-61f05d9b7cd9 tempest-AttachVolumeTestJSON-144497230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b836b7b-31b8-48a5-b61e-566f741deee5" returned: 0 in 0.319s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cab2941e-dfca-4393-b426-61f05d9b7cd9 tempest-AttachVolumeTestJSON-144497230 None] Lock "cinder-quobyte-9b836b7b-31b8-48a5-b61e-566f741deee5" released by "delete_volume" :: held 0.859s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:47 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-cab2941e-dfca-4393-b426-61f05d9b7cd9 tempest-AttachVolumeTestJSON-144497230 None] Created reservations ['555c870b-d285-4d75-81e2-6f56c5c1d670', '35587e86-82ff-408b-8839-eab90bf644ba', 'a0aa421b-cad3-41d1-a779-5efd6bcac368', '9a7cbb5d-8733-4455-af0e-0b8b890c97c5'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cab2941e-dfca-4393-b426-61f05d9b7cd9 tempest-AttachVolumeTestJSON-144497230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cab2941e-dfca-4393-b426-61f05d9b7cd9 tempest-AttachVolumeTestJSON-144497230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:48 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cab2941e-dfca-4393-b426-61f05d9b7cd9 tempest-AttachVolumeTestJSON-144497230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:06:48 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cab2941e-dfca-4393-b426-61f05d9b7cd9 tempest-AttachVolumeTestJSON-144497230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:06:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cab2941e-dfca-4393-b426-61f05d9b7cd9 tempest-AttachVolumeTestJSON-144497230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cab2941e-dfca-4393-b426-61f05d9b7cd9 tempest-AttachVolumeTestJSON-144497230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:48 devstack sudo[92680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:06:48 devstack sudo[92680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:48 devstack sudo[92677]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cd00e2a5-8d82-4392-9e54-97c770d6e190 tempest-SnapshotsActionsTest-763119705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.d84e6b17-fb5c-41fa-979c-00d01fa6d604" returned: 0 in 0.485s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:48 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cd00e2a5-8d82-4392-9e54-97c770d6e190 tempest-SnapshotsActionsTest-763119705 None] Lock "cinder-quobyte-d84e6b17-fb5c-41fa-979c-00d01fa6d604" released by "_delete_snapshot" :: held 2.208s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:48 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cd00e2a5-8d82-4392-9e54-97c770d6e190 tempest-SnapshotsActionsTest-763119705 None] Lock "cinder-quobyte-190ad25c-e138-4140-b5ff-db156e59fc6d" released by "delete_snapshot" :: held 2.241s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:48 devstack cinder-volume[86980]: WARNING cinder.quota [None req-cd00e2a5-8d82-4392-9e54-97c770d6e190 tempest-SnapshotsActionsTest-763119705 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:06:48 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-cd00e2a5-8d82-4392-9e54-97c770d6e190 tempest-SnapshotsActionsTest-763119705 None] Created reservations ['698b30e4-d66d-4abb-bd66-f138848e4488', '110ce4bb-e153-4228-8637-25427dc5c6e6', '6d6e5f92-adef-4681-95da-e393d37f5976', '05c3480c-659b-41c9-94fa-32f1abf9eadb'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:48 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-cd00e2a5-8d82-4392-9e54-97c770d6e190 tempest-SnapshotsActionsTest-763119705 None] Delete snapshot completed successfully. Sep 28 18:06:48 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cd00e2a5-8d82-4392-9e54-97c770d6e190 tempest-SnapshotsActionsTest-763119705 None] Lock "cinder-d84e6b17-fb5c-41fa-979c-00d01fa6d604-delete_snapshot" released by "delete_snapshot" :: held 2.449s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:48 devstack sudo[92680]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cab2941e-dfca-4393-b426-61f05d9b7cd9 tempest-AttachVolumeTestJSON-144497230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.434s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:48 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-cab2941e-dfca-4393-b426-61f05d9b7cd9 tempest-AttachVolumeTestJSON-144497230 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:06:48 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-cab2941e-dfca-4393-b426-61f05d9b7cd9 tempest-AttachVolumeTestJSON-144497230 None] Deleted volume successfully. Sep 28 18:06:48 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cab2941e-dfca-4393-b426-61f05d9b7cd9 tempest-AttachVolumeTestJSON-144497230 None] Lock "cinder-9b836b7b-31b8-48a5-b61e-566f741deee5-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f8d72728-77fd-4294-81f2-acb36d37736f tempest-SnapshotsActionsTest-1278071978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f8d72728-77fd-4294-81f2-acb36d37736f tempest-SnapshotsActionsTest-1278071978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-f8d72728-77fd-4294-81f2-acb36d37736f tempest-SnapshotsActionsTest-1278071978 None] Creating offline snapshot 2e84ea76-3ce5-47d2-ae1d-bf86b80390ee of volume 190ad25c-e138-4140-b5ff-db156e59fc6d {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:06:49 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b68fde2-1668-42d1-9c96-392ba2dfd67e]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f8d72728-77fd-4294-81f2-acb36d37736f tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:50 devstack sudo[92684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 Sep 28 18:06:50 devstack sudo[92684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:50 devstack sudo[92684]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f8d72728-77fd-4294-81f2-acb36d37736f tempest-SnapshotsActionsTest-1278071978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708" returned: 0 in 0.564s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-f8d72728-77fd-4294-81f2-acb36d37736f tempest-SnapshotsActionsTest-1278071978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-190ad25c-e138-4140-b5ff-db156e59fc6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:06:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f8d72728-77fd-4294-81f2-acb36d37736f tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.2e84ea76-3ce5-47d2-ae1d-bf86b80390ee 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:50 devstack sudo[92693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.2e84ea76-3ce5-47d2-ae1d-bf86b80390ee 1G Sep 28 18:06:50 devstack sudo[92693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:51 devstack sudo[92693]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f8d72728-77fd-4294-81f2-acb36d37736f tempest-SnapshotsActionsTest-1278071978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.2e84ea76-3ce5-47d2-ae1d-bf86b80390ee 1G" returned: 0 in 0.635s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f8d72728-77fd-4294-81f2-acb36d37736f tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.2e84ea76-3ce5-47d2-ae1d-bf86b80390ee {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:51 devstack sudo[92699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.2e84ea76-3ce5-47d2-ae1d-bf86b80390ee Sep 28 18:06:51 devstack sudo[92699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:51 devstack sudo[92699]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f8d72728-77fd-4294-81f2-acb36d37736f tempest-SnapshotsActionsTest-1278071978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.2e84ea76-3ce5-47d2-ae1d-bf86b80390ee" returned: 0 in 0.431s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:51 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-f8d72728-77fd-4294-81f2-acb36d37736f tempest-SnapshotsActionsTest-1278071978 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.2e84ea76-3ce5-47d2-ae1d-bf86b80390ee is being set with open permissions: ugo+rw Sep 28 18:06:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f8d72728-77fd-4294-81f2-acb36d37736f tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.2e84ea76-3ce5-47d2-ae1d-bf86b80390ee {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:51 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.2e84ea76-3ce5-47d2-ae1d-bf86b80390ee Sep 28 18:06:51 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:52 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f8d72728-77fd-4294-81f2-acb36d37736f tempest-SnapshotsActionsTest-1278071978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.2e84ea76-3ce5-47d2-ae1d-bf86b80390ee" returned: 0 in 0.498s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f8d72728-77fd-4294-81f2-acb36d37736f tempest-SnapshotsActionsTest-1278071978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.295s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:52 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-f8d72728-77fd-4294-81f2-acb36d37736f tempest-SnapshotsActionsTest-1278071978 None] Create snapshot completed successfully Sep 28 18:06:52 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-a697f22c-4376-4537-a33e-b615a73bdcff req-6a63fc1c-298b-41c4-9d0d-1da64a1a8372 tempest-ServerActionsTestOtherA-1750096549 None] Terminate volume connection completed successfully. Sep 28 18:06:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-a697f22c-4376-4537-a33e-b615a73bdcff req-6a63fc1c-298b-41c4-9d0d-1da64a1a8372 tempest-ServerActionsTestOtherA-1750096549 None] Deleting attachment eac9ebe6-b9ed-4116-86af-80bbe5cadcb9. {{(pid=86980) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:06:53 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6e0208a6-5276-4e39-98cb-1ce31b90a9c8 tempest-SnapshotsActionsTest-763119705 None] Acquiring lock "cinder-2e84ea76-3ce5-47d2-ae1d-bf86b80390ee-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:53 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6e0208a6-5276-4e39-98cb-1ce31b90a9c8 tempest-SnapshotsActionsTest-763119705 None] Lock "cinder-2e84ea76-3ce5-47d2-ae1d-bf86b80390ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:53 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6e0208a6-5276-4e39-98cb-1ce31b90a9c8 tempest-SnapshotsActionsTest-763119705 None] Acquiring lock "cinder-quobyte-190ad25c-e138-4140-b5ff-db156e59fc6d" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:53 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6e0208a6-5276-4e39-98cb-1ce31b90a9c8 tempest-SnapshotsActionsTest-763119705 None] Lock "cinder-quobyte-190ad25c-e138-4140-b5ff-db156e59fc6d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:53 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6e0208a6-5276-4e39-98cb-1ce31b90a9c8 tempest-SnapshotsActionsTest-763119705 None] Acquiring lock "cinder-quobyte-2e84ea76-3ce5-47d2-ae1d-bf86b80390ee" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:06:53 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6e0208a6-5276-4e39-98cb-1ce31b90a9c8 tempest-SnapshotsActionsTest-763119705 None] Lock "cinder-quobyte-2e84ea76-3ce5-47d2-ae1d-bf86b80390ee" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:06:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-6e0208a6-5276-4e39-98cb-1ce31b90a9c8 tempest-SnapshotsActionsTest-763119705 None] Deleting offline snapshot 2e84ea76-3ce5-47d2-ae1d-bf86b80390ee of volume 190ad25c-e138-4140-b5ff-db156e59fc6d {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:06:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-6e0208a6-5276-4e39-98cb-1ce31b90a9c8 tempest-SnapshotsActionsTest-763119705 None] snapshot_file for this snap is: volume-190ad25c-e138-4140-b5ff-db156e59fc6d.2e84ea76-3ce5-47d2-ae1d-bf86b80390ee {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:06:53 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b697438e-d503-4d2c-b05c-37aaf0beb004]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6e0208a6-5276-4e39-98cb-1ce31b90a9c8 tempest-SnapshotsActionsTest-763119705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.2e84ea76-3ce5-47d2-ae1d-bf86b80390ee {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:53 devstack sudo[92716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.2e84ea76-3ce5-47d2-ae1d-bf86b80390ee Sep 28 18:06:53 devstack sudo[92716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:54 devstack sudo[92716]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6e0208a6-5276-4e39-98cb-1ce31b90a9c8 tempest-SnapshotsActionsTest-763119705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.2e84ea76-3ce5-47d2-ae1d-bf86b80390ee" returned: 0 in 0.555s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-6e0208a6-5276-4e39-98cb-1ce31b90a9c8 tempest-SnapshotsActionsTest-763119705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-190ad25c-e138-4140-b5ff-db156e59fc6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:06:54 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3eab50-8755-4096-b253-566fcd157e98]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6e0208a6-5276-4e39-98cb-1ce31b90a9c8 tempest-SnapshotsActionsTest-763119705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:54 devstack sudo[92743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 Sep 28 18:06:54 devstack sudo[92743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:54 devstack sudo[92743]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6e0208a6-5276-4e39-98cb-1ce31b90a9c8 tempest-SnapshotsActionsTest-763119705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708" returned: 0 in 0.531s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-6e0208a6-5276-4e39-98cb-1ce31b90a9c8 tempest-SnapshotsActionsTest-763119705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-190ad25c-e138-4140-b5ff-db156e59fc6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:06:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6e0208a6-5276-4e39-98cb-1ce31b90a9c8 tempest-SnapshotsActionsTest-763119705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.2e84ea76-3ce5-47d2-ae1d-bf86b80390ee {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:54 devstack sudo[92752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.2e84ea76-3ce5-47d2-ae1d-bf86b80390ee Sep 28 18:06:54 devstack sudo[92752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:55 devstack sudo[92752]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6e0208a6-5276-4e39-98cb-1ce31b90a9c8 tempest-SnapshotsActionsTest-763119705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.2e84ea76-3ce5-47d2-ae1d-bf86b80390ee" returned: 0 in 0.599s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6e0208a6-5276-4e39-98cb-1ce31b90a9c8 tempest-SnapshotsActionsTest-763119705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.2e84ea76-3ce5-47d2-ae1d-bf86b80390ee {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:55 devstack sudo[92761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.2e84ea76-3ce5-47d2-ae1d-bf86b80390ee Sep 28 18:06:55 devstack sudo[92761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:55 devstack sudo[92761]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6e0208a6-5276-4e39-98cb-1ce31b90a9c8 tempest-SnapshotsActionsTest-763119705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.2e84ea76-3ce5-47d2-ae1d-bf86b80390ee" returned: 0 in 0.368s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6e0208a6-5276-4e39-98cb-1ce31b90a9c8 tempest-SnapshotsActionsTest-763119705 None] Lock "cinder-quobyte-2e84ea76-3ce5-47d2-ae1d-bf86b80390ee" released by "_delete_snapshot" :: held 2.220s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6e0208a6-5276-4e39-98cb-1ce31b90a9c8 tempest-SnapshotsActionsTest-763119705 None] Lock "cinder-quobyte-190ad25c-e138-4140-b5ff-db156e59fc6d" released by "delete_snapshot" :: held 2.266s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:55 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-6e0208a6-5276-4e39-98cb-1ce31b90a9c8 tempest-SnapshotsActionsTest-763119705 None] Created reservations ['f56979f4-527e-4702-b5c4-0eed2613a9de', 'afdf7bd7-3ee0-4bbf-9f0d-919ae0ec9322', '062e9681-a284-42b0-8af3-9af018b632dd', '997d7af3-eb9c-44a7-a2f3-57c11bd1c61d'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:06:55 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-6e0208a6-5276-4e39-98cb-1ce31b90a9c8 tempest-SnapshotsActionsTest-763119705 None] Delete snapshot completed successfully. Sep 28 18:06:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6e0208a6-5276-4e39-98cb-1ce31b90a9c8 tempest-SnapshotsActionsTest-763119705 None] Lock "cinder-2e84ea76-3ce5-47d2-ae1d-bf86b80390ee-delete_snapshot" released by "delete_snapshot" :: held 2.500s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:06:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-94a68888-40a6-4c2e-b56f-79da213fa4ea tempest-SnapshotsActionsTest-1278071978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:06:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-94a68888-40a6-4c2e-b56f-79da213fa4ea tempest-SnapshotsActionsTest-1278071978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:06:57 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-94a68888-40a6-4c2e-b56f-79da213fa4ea tempest-SnapshotsActionsTest-1278071978 None] Creating offline snapshot b2cf5139-289e-4a36-9970-072d1996d0e3 of volume 190ad25c-e138-4140-b5ff-db156e59fc6d {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:06:57 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[449b1900-4e65-426b-9aad-36f847bdde4f]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:06:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-94a68888-40a6-4c2e-b56f-79da213fa4ea tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:57 devstack sudo[92766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 Sep 28 18:06:57 devstack sudo[92766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:57 devstack sudo[92766]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-94a68888-40a6-4c2e-b56f-79da213fa4ea tempest-SnapshotsActionsTest-1278071978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708" returned: 0 in 0.533s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:57 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-94a68888-40a6-4c2e-b56f-79da213fa4ea tempest-SnapshotsActionsTest-1278071978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-190ad25c-e138-4140-b5ff-db156e59fc6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:06:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-94a68888-40a6-4c2e-b56f-79da213fa4ea tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.b2cf5139-289e-4a36-9970-072d1996d0e3 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:57 devstack sudo[92773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.b2cf5139-289e-4a36-9970-072d1996d0e3 1G Sep 28 18:06:57 devstack sudo[92773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:58 devstack sudo[92773]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-94a68888-40a6-4c2e-b56f-79da213fa4ea tempest-SnapshotsActionsTest-1278071978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.b2cf5139-289e-4a36-9970-072d1996d0e3 1G" returned: 0 in 0.744s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-94a68888-40a6-4c2e-b56f-79da213fa4ea tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.b2cf5139-289e-4a36-9970-072d1996d0e3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:58 devstack sudo[92782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.b2cf5139-289e-4a36-9970-072d1996d0e3 Sep 28 18:06:58 devstack sudo[92782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:58 devstack sudo[92782]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-94a68888-40a6-4c2e-b56f-79da213fa4ea tempest-SnapshotsActionsTest-1278071978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.b2cf5139-289e-4a36-9970-072d1996d0e3" returned: 0 in 0.392s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:58 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-94a68888-40a6-4c2e-b56f-79da213fa4ea tempest-SnapshotsActionsTest-1278071978 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.b2cf5139-289e-4a36-9970-072d1996d0e3 is being set with open permissions: ugo+rw Sep 28 18:06:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-94a68888-40a6-4c2e-b56f-79da213fa4ea tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.b2cf5139-289e-4a36-9970-072d1996d0e3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:06:59 devstack sudo[92791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.b2cf5139-289e-4a36-9970-072d1996d0e3 Sep 28 18:06:59 devstack sudo[92791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:06:59 devstack sudo[92791]: pam_unix(sudo:session): session closed for user root Sep 28 18:06:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-94a68888-40a6-4c2e-b56f-79da213fa4ea tempest-SnapshotsActionsTest-1278071978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.b2cf5139-289e-4a36-9970-072d1996d0e3" returned: 0 in 0.296s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:06:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-94a68888-40a6-4c2e-b56f-79da213fa4ea tempest-SnapshotsActionsTest-1278071978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.138s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:06:59 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-94a68888-40a6-4c2e-b56f-79da213fa4ea tempest-SnapshotsActionsTest-1278071978 None] Create snapshot completed successfully Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Flow 'volume_create_manager' (3452cd91-b4d9-4e50-8e02-3ca85f8c29af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f1e81d-0baa-4673-b264-df752e0bf93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f1e81d-0baa-4673-b264-df752e0bf93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1301184027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bcbedeba10a4474855bfb6d1ea7e14e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:00Z,use_quota=True,user_id='b6dd76220dd24f3394e885ab5b2669a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d928903-5800-4cfa-9037-9bf153172308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d928903-5800-4cfa-9037-9bf153172308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e45cac2b-f63b-41ac-bdbd-9c05b19fa52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e45cac2b-f63b-41ac-bdbd-9c05b19fa52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95', 'volume_name': 'volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c27e81c-9661-41f8-b6bb-8db90ed04c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c27e81c-9661-41f8-b6bb-8db90ed04c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9798d3a7-8301-4d99-9b1f-4b5734c8c789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:00 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Volume 2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95', 'volume_size': 1} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1301184027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bcbedeba10a4474855bfb6d1ea7e14e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:00Z,use_quota=True,user_id='b6dd76220dd24f3394e885ab5b2669a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Creating volume 2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:07:00 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-550d123d-0831-4d85-b2d8-7d9ac46dcdef tempest-SnapshotsActionsTest-763119705 None] Acquiring lock "cinder-b2cf5139-289e-4a36-9970-072d1996d0e3-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:00 devstack sudo[92795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95 1073741824 Sep 28 18:07:00 devstack sudo[92795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-550d123d-0831-4d85-b2d8-7d9ac46dcdef tempest-SnapshotsActionsTest-763119705 None] Lock "cinder-b2cf5139-289e-4a36-9970-072d1996d0e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-550d123d-0831-4d85-b2d8-7d9ac46dcdef tempest-SnapshotsActionsTest-763119705 None] Acquiring lock "cinder-quobyte-190ad25c-e138-4140-b5ff-db156e59fc6d" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-550d123d-0831-4d85-b2d8-7d9ac46dcdef tempest-SnapshotsActionsTest-763119705 None] Lock "cinder-quobyte-190ad25c-e138-4140-b5ff-db156e59fc6d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-550d123d-0831-4d85-b2d8-7d9ac46dcdef tempest-SnapshotsActionsTest-763119705 None] Acquiring lock "cinder-quobyte-b2cf5139-289e-4a36-9970-072d1996d0e3" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-550d123d-0831-4d85-b2d8-7d9ac46dcdef tempest-SnapshotsActionsTest-763119705 None] Lock "cinder-quobyte-b2cf5139-289e-4a36-9970-072d1996d0e3" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-550d123d-0831-4d85-b2d8-7d9ac46dcdef tempest-SnapshotsActionsTest-763119705 None] Deleting offline snapshot b2cf5139-289e-4a36-9970-072d1996d0e3 of volume 190ad25c-e138-4140-b5ff-db156e59fc6d {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-550d123d-0831-4d85-b2d8-7d9ac46dcdef tempest-SnapshotsActionsTest-763119705 None] snapshot_file for this snap is: volume-190ad25c-e138-4140-b5ff-db156e59fc6d.b2cf5139-289e-4a36-9970-072d1996d0e3 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3a9799-c06d-4561-97e6-1e26c466c8c7]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-550d123d-0831-4d85-b2d8-7d9ac46dcdef tempest-SnapshotsActionsTest-763119705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.b2cf5139-289e-4a36-9970-072d1996d0e3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:00 devstack sudo[92797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.b2cf5139-289e-4a36-9970-072d1996d0e3 Sep 28 18:07:00 devstack sudo[92797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Flow 'volume_create_manager' (11c2d104-b588-43f9-b967-dc3363a1dae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e783a623-a4f0-4b74-8563-4e4ddd1a29cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e783a623-a4f0-4b74-8563-4e4ddd1a29cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1717586262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ec1b80-13ff-430a-8431-4e46a2ff9441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dea64611b2e464fb9754b195a49404b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:01Z,use_quota=True,user_id='cd198dd8e13546c9a4aeda280a7a02d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b0e44f3-f5cc-4cbf-bd7f-1535cc5cb163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b0e44f3-f5cc-4cbf-bd7f-1535cc5cb163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c67855d0-a8b3-42d1-9a9f-643e32fafdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:01 devstack cinder-volume[86980]: DEBUG cinder.image.glance [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Creating Keystone auth plugin from conf {{(pid=86980) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:07:01 devstack sudo[92795]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95 1073741824" returned: 0 in 0.662s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:01 devstack sudo[92797]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-550d123d-0831-4d85-b2d8-7d9ac46dcdef tempest-SnapshotsActionsTest-763119705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.b2cf5139-289e-4a36-9970-072d1996d0e3" returned: 0 in 0.560s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-550d123d-0831-4d85-b2d8-7d9ac46dcdef tempest-SnapshotsActionsTest-763119705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-190ad25c-e138-4140-b5ff-db156e59fc6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:07:01 devstack sudo[92806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95 Sep 28 18:07:01 devstack sudo[92806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:01 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a04042b-ee82-41fd-9437-7349a0366fc4]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-550d123d-0831-4d85-b2d8-7d9ac46dcdef tempest-SnapshotsActionsTest-763119705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:01 devstack sudo[92808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 Sep 28 18:07:01 devstack sudo[92808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:01 devstack sudo[92806]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95" returned: 0 in 0.317s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:07:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9798d3a7-8301-4d99-9b1f-4b5734c8c789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (634409c6-efb6-4b93-b889-a41bbd696081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c67855d0-a8b3-42d1-9a9f-643e32fafdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '55ec1b80-13ff-430a-8431-4e46a2ff9441', 'volume_name': 'volume-55ec1b80-13ff-430a-8431-4e46a2ff9441', 'volume_size': 1, 'image_id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c13a4cea8f714bb0b9012709acb9372b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'created_at': datetime.datetime(2026, 9, 28, 15, 57, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 57, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c56765fa-c281-41cc-8bfa-b48becf03679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c56765fa-c281-41cc-8bfa-b48becf03679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c34a1c-83d0-444a-8f5c-102cb1f1fa87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:01 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Volume 55ec1b80-13ff-430a-8431-4e46a2ff9441: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-55ec1b80-13ff-430a-8431-4e46a2ff9441', 'volume_size': 1, 'image_id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c13a4cea8f714bb0b9012709acb9372b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'created_at': datetime.datetime(2026, 9, 28, 15, 57, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 57, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 18:07:01 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Trying to clone 55ec1b80-13ff-430a-8431-4e46a2ff9441 from image d5838d4d-ebb7-4d18-8c3c-fc660c294083 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}]). {{(pid=86980) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:07:01 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Volume volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95 (2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95): created successfully Sep 28 18:07:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (634409c6-efb6-4b93-b889-a41bbd696081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Flow 'volume_create_manager' (3452cd91-b4d9-4e50-8e02-3ca85f8c29af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:07:01 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-4b2b282f-a276-4b65-9579-e5b1dc49bb81 req-ec161bdf-0d37-4160-a9c2-ab2f8048e292 tempest-VolumesSnapshotsTestJSON-1523483912 None] Created volume successfully. Sep 28 18:07:01 devstack sudo[92808]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-550d123d-0831-4d85-b2d8-7d9ac46dcdef tempest-SnapshotsActionsTest-763119705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708" returned: 0 in 0.598s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-550d123d-0831-4d85-b2d8-7d9ac46dcdef tempest-SnapshotsActionsTest-763119705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-190ad25c-e138-4140-b5ff-db156e59fc6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:07:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-550d123d-0831-4d85-b2d8-7d9ac46dcdef tempest-SnapshotsActionsTest-763119705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.b2cf5139-289e-4a36-9970-072d1996d0e3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:02 devstack sudo[92834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.b2cf5139-289e-4a36-9970-072d1996d0e3 Sep 28 18:07:02 devstack sudo[92834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:02 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_v5v5huiedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:07:02 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Image download 20.69 MB at 20.69 MB/s Sep 28 18:07:02 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b3df0b-c60d-45c8-af04-1f75fcc236c0]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_v5v5huiedevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:02 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_v5v5huiedevstack@QuobyteHD Sep 28 18:07:02 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:02 devstack sudo[92834]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-550d123d-0831-4d85-b2d8-7d9ac46dcdef tempest-SnapshotsActionsTest-763119705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.b2cf5139-289e-4a36-9970-072d1996d0e3" returned: 0 in 0.727s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-550d123d-0831-4d85-b2d8-7d9ac46dcdef tempest-SnapshotsActionsTest-763119705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.b2cf5139-289e-4a36-9970-072d1996d0e3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:02 devstack sudo[92843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.b2cf5139-289e-4a36-9970-072d1996d0e3 Sep 28 18:07:02 devstack sudo[92843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:02 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_v5v5huiedevstack@QuobyteHD" returned: 0 in 0.490s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:02 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Temporary image d5838d4d-ebb7-4d18-8c3c-fc660c294083 is fetched for user cd198dd8e13546c9a4aeda280a7a02d7. {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:07:02 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfb31a0-7112-4f2b-b029-f3332f1ee377]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_v5v5huiedevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-f74752fe-fee7-4700-a088-e018cfeecfb6 req-38707c22-11a3-4103-acad-e17abdd66dd4 tempest-VolumesSnapshotsTestJSON-1523483912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-f74752fe-fee7-4700-a088-e018cfeecfb6 req-38707c22-11a3-4103-acad-e17abdd66dd4 tempest-VolumesSnapshotsTestJSON-1523483912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [req-f74752fe-fee7-4700-a088-e018cfeecfb6 req-38707c22-11a3-4103-acad-e17abdd66dd4 tempest-VolumesSnapshotsTestJSON-1523483912 None] Creating offline snapshot 718a408d-326d-4d97-aa4c-58d55b8f56fa of volume 2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:07:03 devstack sudo[92848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_v5v5huiedevstack@QuobyteHD Sep 28 18:07:03 devstack sudo[92848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:03 devstack sudo[92843]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-550d123d-0831-4d85-b2d8-7d9ac46dcdef tempest-SnapshotsActionsTest-763119705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.b2cf5139-289e-4a36-9970-072d1996d0e3" returned: 0 in 0.472s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:03 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c701dc17-4686-47ae-bd0b-8f8bd2c226f1]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-f74752fe-fee7-4700-a088-e018cfeecfb6 req-38707c22-11a3-4103-acad-e17abdd66dd4 tempest-VolumesSnapshotsTestJSON-1523483912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:03 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-550d123d-0831-4d85-b2d8-7d9ac46dcdef tempest-SnapshotsActionsTest-763119705 None] Lock "cinder-quobyte-b2cf5139-289e-4a36-9970-072d1996d0e3" released by "_delete_snapshot" :: held 2.567s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:03 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-550d123d-0831-4d85-b2d8-7d9ac46dcdef tempest-SnapshotsActionsTest-763119705 None] Lock "cinder-quobyte-190ad25c-e138-4140-b5ff-db156e59fc6d" released by "delete_snapshot" :: held 2.611s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:03 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-550d123d-0831-4d85-b2d8-7d9ac46dcdef tempest-SnapshotsActionsTest-763119705 None] Created reservations ['113275a6-2484-40a4-89c0-541ef5a9a51e', 'ec64fa6c-1222-43ad-b000-0757208428f3', '237678b4-7e57-4d90-9aa3-df83ac2b1333', '4f7ed493-3b34-44e0-bcf5-316e49eae343'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:07:03 devstack sudo[92851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95 Sep 28 18:07:03 devstack sudo[92851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:03 devstack sudo[92848]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_v5v5huiedevstack@QuobyteHD" returned: 0 in 0.516s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:03 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-550d123d-0831-4d85-b2d8-7d9ac46dcdef tempest-SnapshotsActionsTest-763119705 None] Delete snapshot completed successfully. Sep 28 18:07:03 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-550d123d-0831-4d85-b2d8-7d9ac46dcdef tempest-SnapshotsActionsTest-763119705 None] Lock "cinder-b2cf5139-289e-4a36-9970-072d1996d0e3-delete_snapshot" released by "delete_snapshot" :: held 2.914s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:03 devstack sudo[92851]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-f74752fe-fee7-4700-a088-e018cfeecfb6 req-38707c22-11a3-4103-acad-e17abdd66dd4 tempest-VolumesSnapshotsTestJSON-1523483912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95" returned: 0 in 0.596s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-f74752fe-fee7-4700-a088-e018cfeecfb6 req-38707c22-11a3-4103-acad-e17abdd66dd4 tempest-VolumesSnapshotsTestJSON-1523483912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95.718a408d-326d-4d97-aa4c-58d55b8f56fa 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:03 devstack sudo[92860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95.718a408d-326d-4d97-aa4c-58d55b8f56fa 1G Sep 28 18:07:03 devstack sudo[92860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a849261b-1908-4e7b-a0b2-32dca86bd49e tempest-SnapshotsActionsTest-1278071978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:04 devstack sudo[92860]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-f74752fe-fee7-4700-a088-e018cfeecfb6 req-38707c22-11a3-4103-acad-e17abdd66dd4 tempest-VolumesSnapshotsTestJSON-1523483912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95.718a408d-326d-4d97-aa4c-58d55b8f56fa 1G" returned: 0 in 0.661s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-f74752fe-fee7-4700-a088-e018cfeecfb6 req-38707c22-11a3-4103-acad-e17abdd66dd4 tempest-VolumesSnapshotsTestJSON-1523483912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95.718a408d-326d-4d97-aa4c-58d55b8f56fa {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:04 devstack sudo[92866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95.718a408d-326d-4d97-aa4c-58d55b8f56fa Sep 28 18:07:04 devstack sudo[92866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:07:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:04 devstack sudo[92868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:07:04 devstack sudo[92868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:04 devstack sudo[92868]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.339s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:04 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:07:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager._thread_info {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:07:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread count: 28 {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:07:04 devstack sudo[92866]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread info: [<_MainThread(MainThread, started 129097393381504)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:07:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-f74752fe-fee7-4700-a088-e018cfeecfb6 req-38707c22-11a3-4103-acad-e17abdd66dd4 tempest-VolumesSnapshotsTestJSON-1523483912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95.718a408d-326d-4d97-aa4c-58d55b8f56fa" returned: 0 in 0.466s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:04 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [req-f74752fe-fee7-4700-a088-e018cfeecfb6 req-38707c22-11a3-4103-acad-e17abdd66dd4 tempest-VolumesSnapshotsTestJSON-1523483912 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95.718a408d-326d-4d97-aa4c-58d55b8f56fa is being set with open permissions: ugo+rw Sep 28 18:07:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-f74752fe-fee7-4700-a088-e018cfeecfb6 req-38707c22-11a3-4103-acad-e17abdd66dd4 tempest-VolumesSnapshotsTestJSON-1523483912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95.718a408d-326d-4d97-aa4c-58d55b8f56fa {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:04 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95.718a408d-326d-4d97-aa4c-58d55b8f56fa Sep 28 18:07:04 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:05 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-f74752fe-fee7-4700-a088-e018cfeecfb6 req-38707c22-11a3-4103-acad-e17abdd66dd4 tempest-VolumesSnapshotsTestJSON-1523483912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95.718a408d-326d-4d97-aa4c-58d55b8f56fa" returned: 0 in 0.305s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-f74752fe-fee7-4700-a088-e018cfeecfb6 req-38707c22-11a3-4103-acad-e17abdd66dd4 tempest-VolumesSnapshotsTestJSON-1523483912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:05 devstack sudo[92877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95.info Sep 28 18:07:05 devstack sudo[92877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:05 devstack sudo[92877]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-f74752fe-fee7-4700-a088-e018cfeecfb6 req-38707c22-11a3-4103-acad-e17abdd66dd4 tempest-VolumesSnapshotsTestJSON-1523483912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95.info" returned: 0 in 0.305s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:05 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [req-f74752fe-fee7-4700-a088-e018cfeecfb6 req-38707c22-11a3-4103-acad-e17abdd66dd4 tempest-VolumesSnapshotsTestJSON-1523483912 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95.info is being set with open permissions: ugo+rw Sep 28 18:07:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-f74752fe-fee7-4700-a088-e018cfeecfb6 req-38707c22-11a3-4103-acad-e17abdd66dd4 tempest-VolumesSnapshotsTestJSON-1523483912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:05 devstack sudo[92880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95.info Sep 28 18:07:05 devstack sudo[92880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:05 devstack sudo[92880]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-f74752fe-fee7-4700-a088-e018cfeecfb6 req-38707c22-11a3-4103-acad-e17abdd66dd4 tempest-VolumesSnapshotsTestJSON-1523483912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95.info" returned: 0 in 0.297s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-f74752fe-fee7-4700-a088-e018cfeecfb6 req-38707c22-11a3-4103-acad-e17abdd66dd4 tempest-VolumesSnapshotsTestJSON-1523483912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.814s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.410s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1717586262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ec1b80-13ff-430a-8431-4e46a2ff9441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dea64611b2e464fb9754b195a49404b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:01Z,use_quota=True,user_id='cd198dd8e13546c9a4aeda280a7a02d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:07:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Creating volume 55ec1b80-13ff-430a-8431-4e46a2ff9441 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:07:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:07:05 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:07:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55ec1b80-13ff-430a-8431-4e46a2ff9441 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:05 devstack sudo[92883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55ec1b80-13ff-430a-8431-4e46a2ff9441 1073741824 Sep 28 18:07:05 devstack sudo[92883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:05 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-f74752fe-fee7-4700-a088-e018cfeecfb6 req-38707c22-11a3-4103-acad-e17abdd66dd4 tempest-VolumesSnapshotsTestJSON-1523483912 None] Create snapshot completed successfully Sep 28 18:07:06 devstack sudo[92883]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55ec1b80-13ff-430a-8431-4e46a2ff9441 1073741824" returned: 0 in 0.588s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55ec1b80-13ff-430a-8431-4e46a2ff9441 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:06 devstack sudo[92889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55ec1b80-13ff-430a-8431-4e46a2ff9441 Sep 28 18:07:06 devstack sudo[92889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-df235fe8-10aa-41e2-83db-781fddd2e8c9 req-f3eb9c08-8c3b-4403-b24d-7880af35ed3d tempest-VolumesSnapshotsTestJSON-1523483912 None] Acquiring lock "cinder-718a408d-326d-4d97-aa4c-58d55b8f56fa-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-df235fe8-10aa-41e2-83db-781fddd2e8c9 req-f3eb9c08-8c3b-4403-b24d-7880af35ed3d tempest-VolumesSnapshotsTestJSON-1523483912 None] Lock "cinder-718a408d-326d-4d97-aa4c-58d55b8f56fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-df235fe8-10aa-41e2-83db-781fddd2e8c9 req-f3eb9c08-8c3b-4403-b24d-7880af35ed3d tempest-VolumesSnapshotsTestJSON-1523483912 None] Acquiring lock "cinder-quobyte-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-df235fe8-10aa-41e2-83db-781fddd2e8c9 req-f3eb9c08-8c3b-4403-b24d-7880af35ed3d tempest-VolumesSnapshotsTestJSON-1523483912 None] Lock "cinder-quobyte-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-df235fe8-10aa-41e2-83db-781fddd2e8c9 req-f3eb9c08-8c3b-4403-b24d-7880af35ed3d tempest-VolumesSnapshotsTestJSON-1523483912 None] Acquiring lock "cinder-quobyte-718a408d-326d-4d97-aa4c-58d55b8f56fa" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-df235fe8-10aa-41e2-83db-781fddd2e8c9 req-f3eb9c08-8c3b-4403-b24d-7880af35ed3d tempest-VolumesSnapshotsTestJSON-1523483912 None] Lock "cinder-quobyte-718a408d-326d-4d97-aa4c-58d55b8f56fa" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [req-df235fe8-10aa-41e2-83db-781fddd2e8c9 req-f3eb9c08-8c3b-4403-b24d-7880af35ed3d tempest-VolumesSnapshotsTestJSON-1523483912 None] Deleting offline snapshot 718a408d-326d-4d97-aa4c-58d55b8f56fa of volume 2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:07:06 devstack sudo[92889]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [req-df235fe8-10aa-41e2-83db-781fddd2e8c9 req-f3eb9c08-8c3b-4403-b24d-7880af35ed3d tempest-VolumesSnapshotsTestJSON-1523483912 None] snapshot_file for this snap is: volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95.718a408d-326d-4d97-aa4c-58d55b8f56fa {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:07:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55ec1b80-13ff-430a-8431-4e46a2ff9441" returned: 0 in 0.480s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:07:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a849261b-1908-4e7b-a0b2-32dca86bd49e tempest-SnapshotsActionsTest-1278071978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.790s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:07 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfb2731-40de-4a94-a138-4706d160b578]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-df235fe8-10aa-41e2-83db-781fddd2e8c9 req-f3eb9c08-8c3b-4403-b24d-7880af35ed3d tempest-VolumesSnapshotsTestJSON-1523483912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95.718a408d-326d-4d97-aa4c-58d55b8f56fa {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-a849261b-1908-4e7b-a0b2-32dca86bd49e tempest-SnapshotsActionsTest-1278071978 None] Creating offline snapshot 65ce1d4c-9937-45e3-8ddd-d7d14a97c2e7 of volume 190ad25c-e138-4140-b5ff-db156e59fc6d {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:07:07 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Attempting download of d5838d4d-ebb7-4d18-8c3c-fc660c294083 ((None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}])) to volume 55ec1b80-13ff-430a-8431-4e46a2ff9441. {{(pid=86980) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:07:07 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[667711d3-e3cf-416a-a03a-9bcf4d76137a]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a849261b-1908-4e7b-a0b2-32dca86bd49e tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:07 devstack sudo[92892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95.718a408d-326d-4d97-aa4c-58d55b8f56fa Sep 28 18:07:07 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:07 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a907f701-f5c9-42c8-8425-ada527e58e21]: (4, 'raw') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_t_zrfz11 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:07 devstack sudo[92893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 Sep 28 18:07:07 devstack sudo[92893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:07 devstack sudo[92895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_t_zrfz11 Sep 28 18:07:07 devstack sudo[92895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:07 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-df235fe8-10aa-41e2-83db-781fddd2e8c9 req-f3eb9c08-8c3b-4403-b24d-7880af35ed3d tempest-VolumesSnapshotsTestJSON-1523483912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95.718a408d-326d-4d97-aa4c-58d55b8f56fa" returned: 0 in 0.588s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [req-df235fe8-10aa-41e2-83db-781fddd2e8c9 req-f3eb9c08-8c3b-4403-b24d-7880af35ed3d tempest-VolumesSnapshotsTestJSON-1523483912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:07:07 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bba3daa-a887-491e-933b-fb5ed2d39686]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-df235fe8-10aa-41e2-83db-781fddd2e8c9 req-f3eb9c08-8c3b-4403-b24d-7880af35ed3d tempest-VolumesSnapshotsTestJSON-1523483912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:07 devstack sudo[92893]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a849261b-1908-4e7b-a0b2-32dca86bd49e tempest-SnapshotsActionsTest-1278071978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708" returned: 0 in 0.579s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-a849261b-1908-4e7b-a0b2-32dca86bd49e tempest-SnapshotsActionsTest-1278071978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-190ad25c-e138-4140-b5ff-db156e59fc6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:07:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a849261b-1908-4e7b-a0b2-32dca86bd49e tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.65ce1d4c-9937-45e3-8ddd-d7d14a97c2e7 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:07 devstack sudo[92905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.65ce1d4c-9937-45e3-8ddd-d7d14a97c2e7 1G Sep 28 18:07:07 devstack sudo[92905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:07 devstack sudo[92904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95 Sep 28 18:07:07 devstack sudo[92904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:07 devstack sudo[92895]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_t_zrfz11" returned: 0 in 0.631s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_t_zrfz11 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:08 devstack sudo[92910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_t_zrfz11 Sep 28 18:07:08 devstack sudo[92910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:08 devstack sudo[92904]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-df235fe8-10aa-41e2-83db-781fddd2e8c9 req-f3eb9c08-8c3b-4403-b24d-7880af35ed3d tempest-VolumesSnapshotsTestJSON-1523483912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95" returned: 0 in 0.572s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-df235fe8-10aa-41e2-83db-781fddd2e8c9 req-f3eb9c08-8c3b-4403-b24d-7880af35ed3d tempest-VolumesSnapshotsTestJSON-1523483912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95.718a408d-326d-4d97-aa4c-58d55b8f56fa {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:08 devstack sudo[92920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95.718a408d-326d-4d97-aa4c-58d55b8f56fa Sep 28 18:07:08 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:08 devstack sudo[92910]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_t_zrfz11" returned: 1 in 0.438s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_t_zrfz11' failed. Not Retrying. {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:07:08 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[86097986-f6d2-4164-a02c-fdaa8a0a8581]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_v5v5huiedevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:08 devstack sudo[92905]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a849261b-1908-4e7b-a0b2-32dca86bd49e tempest-SnapshotsActionsTest-1278071978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.65ce1d4c-9937-45e3-8ddd-d7d14a97c2e7 1G" returned: 0 in 0.721s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a849261b-1908-4e7b-a0b2-32dca86bd49e tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.65ce1d4c-9937-45e3-8ddd-d7d14a97c2e7 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:08 devstack sudo[92923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_v5v5huiedevstack@QuobyteHD Sep 28 18:07:08 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:08 devstack sudo[92924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.65ce1d4c-9937-45e3-8ddd-d7d14a97c2e7 Sep 28 18:07:08 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:08 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-df235fe8-10aa-41e2-83db-781fddd2e8c9 req-f3eb9c08-8c3b-4403-b24d-7880af35ed3d tempest-VolumesSnapshotsTestJSON-1523483912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95.718a408d-326d-4d97-aa4c-58d55b8f56fa" returned: 0 in 0.455s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-df235fe8-10aa-41e2-83db-781fddd2e8c9 req-f3eb9c08-8c3b-4403-b24d-7880af35ed3d tempest-VolumesSnapshotsTestJSON-1523483912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95.718a408d-326d-4d97-aa4c-58d55b8f56fa {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:08 devstack sudo[92933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95.718a408d-326d-4d97-aa4c-58d55b8f56fa Sep 28 18:07:08 devstack sudo[92933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:08 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_v5v5huiedevstack@QuobyteHD" returned: 0 in 0.494s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:08 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] d5838d4d-ebb7-4d18-8c3c-fc660c294083 was qcow2, converting to qcow2 {{(pid=86980) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:07:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_v5v5huiedevstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55ec1b80-13ff-430a-8431-4e46a2ff9441 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:08 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a849261b-1908-4e7b-a0b2-32dca86bd49e tempest-SnapshotsActionsTest-1278071978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.65ce1d4c-9937-45e3-8ddd-d7d14a97c2e7" returned: 0 in 0.386s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:08 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-a849261b-1908-4e7b-a0b2-32dca86bd49e tempest-SnapshotsActionsTest-1278071978 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.65ce1d4c-9937-45e3-8ddd-d7d14a97c2e7 is being set with open permissions: ugo+rw Sep 28 18:07:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a849261b-1908-4e7b-a0b2-32dca86bd49e tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.65ce1d4c-9937-45e3-8ddd-d7d14a97c2e7 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:08 devstack sudo[92939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_v5v5huiedevstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55ec1b80-13ff-430a-8431-4e46a2ff9441 Sep 28 18:07:08 devstack sudo[92939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:08 devstack sudo[92940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.65ce1d4c-9937-45e3-8ddd-d7d14a97c2e7 Sep 28 18:07:08 devstack sudo[92940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:09 devstack sudo[92933]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-df235fe8-10aa-41e2-83db-781fddd2e8c9 req-f3eb9c08-8c3b-4403-b24d-7880af35ed3d tempest-VolumesSnapshotsTestJSON-1523483912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95.718a408d-326d-4d97-aa4c-58d55b8f56fa" returned: 0 in 0.348s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:09 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-df235fe8-10aa-41e2-83db-781fddd2e8c9 req-f3eb9c08-8c3b-4403-b24d-7880af35ed3d tempest-VolumesSnapshotsTestJSON-1523483912 None] Lock "cinder-quobyte-718a408d-326d-4d97-aa4c-58d55b8f56fa" released by "_delete_snapshot" :: held 2.194s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:09 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-df235fe8-10aa-41e2-83db-781fddd2e8c9 req-f3eb9c08-8c3b-4403-b24d-7880af35ed3d tempest-VolumesSnapshotsTestJSON-1523483912 None] Lock "cinder-quobyte-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95" released by "delete_snapshot" :: held 2.259s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:09 devstack sudo[92940]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a849261b-1908-4e7b-a0b2-32dca86bd49e tempest-SnapshotsActionsTest-1278071978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.65ce1d4c-9937-45e3-8ddd-d7d14a97c2e7" returned: 0 in 0.349s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a849261b-1908-4e7b-a0b2-32dca86bd49e tempest-SnapshotsActionsTest-1278071978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.218s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:09 devstack cinder-volume[86980]: DEBUG cinder.quota [req-df235fe8-10aa-41e2-83db-781fddd2e8c9 req-f3eb9c08-8c3b-4403-b24d-7880af35ed3d tempest-VolumesSnapshotsTestJSON-1523483912 None] Created reservations ['ae0544c4-1c95-4cec-ba75-01bfc46ae29c', 'bde6ef3a-60c8-4d93-855d-ec093a50eb0a', '1b89af3b-15ac-4e90-bf0c-9352a055a099', '52cd4c55-f959-42da-9e86-6d7d25693b76'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:07:09 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-a849261b-1908-4e7b-a0b2-32dca86bd49e tempest-SnapshotsActionsTest-1278071978 None] Create snapshot completed successfully Sep 28 18:07:09 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-df235fe8-10aa-41e2-83db-781fddd2e8c9 req-f3eb9c08-8c3b-4403-b24d-7880af35ed3d tempest-VolumesSnapshotsTestJSON-1523483912 None] Delete snapshot completed successfully. Sep 28 18:07:09 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-df235fe8-10aa-41e2-83db-781fddd2e8c9 req-f3eb9c08-8c3b-4403-b24d-7880af35ed3d tempest-VolumesSnapshotsTestJSON-1523483912 None] Lock "cinder-718a408d-326d-4d97-aa4c-58d55b8f56fa-delete_snapshot" released by "delete_snapshot" :: held 2.536s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:09 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f8d0ca40-04ab-49d1-b2dd-15f36800eaa5 tempest-SnapshotsActionsTest-763119705 None] Acquiring lock "cinder-65ce1d4c-9937-45e3-8ddd-d7d14a97c2e7-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:09 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f8d0ca40-04ab-49d1-b2dd-15f36800eaa5 tempest-SnapshotsActionsTest-763119705 None] Lock "cinder-65ce1d4c-9937-45e3-8ddd-d7d14a97c2e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:09 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f8d0ca40-04ab-49d1-b2dd-15f36800eaa5 tempest-SnapshotsActionsTest-763119705 None] Acquiring lock "cinder-quobyte-190ad25c-e138-4140-b5ff-db156e59fc6d" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:09 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f8d0ca40-04ab-49d1-b2dd-15f36800eaa5 tempest-SnapshotsActionsTest-763119705 None] Lock "cinder-quobyte-190ad25c-e138-4140-b5ff-db156e59fc6d" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:09 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f8d0ca40-04ab-49d1-b2dd-15f36800eaa5 tempest-SnapshotsActionsTest-763119705 None] Acquiring lock "cinder-quobyte-65ce1d4c-9937-45e3-8ddd-d7d14a97c2e7" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:09 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f8d0ca40-04ab-49d1-b2dd-15f36800eaa5 tempest-SnapshotsActionsTest-763119705 None] Lock "cinder-quobyte-65ce1d4c-9937-45e3-8ddd-d7d14a97c2e7" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-f8d0ca40-04ab-49d1-b2dd-15f36800eaa5 tempest-SnapshotsActionsTest-763119705 None] Deleting offline snapshot 65ce1d4c-9937-45e3-8ddd-d7d14a97c2e7 of volume 190ad25c-e138-4140-b5ff-db156e59fc6d {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:07:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-f8d0ca40-04ab-49d1-b2dd-15f36800eaa5 tempest-SnapshotsActionsTest-763119705 None] snapshot_file for this snap is: volume-190ad25c-e138-4140-b5ff-db156e59fc6d.65ce1d4c-9937-45e3-8ddd-d7d14a97c2e7 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:07:09 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4035bc75-fe5a-4ab9-a766-9a43a170adc7]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f8d0ca40-04ab-49d1-b2dd-15f36800eaa5 tempest-SnapshotsActionsTest-763119705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.65ce1d4c-9937-45e3-8ddd-d7d14a97c2e7 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:09 devstack sudo[92954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.65ce1d4c-9937-45e3-8ddd-d7d14a97c2e7 Sep 28 18:07:09 devstack sudo[92954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:10 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-846e9cde-266f-48ad-8ace-578b0360b9d7 req-7a3b5e97-85da-4f2d-b05d-da01be91755c tempest-VolumesSnapshotsTestJSON-1523483912 None] Acquiring lock "cinder-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:10 devstack sudo[92954]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:10 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-846e9cde-266f-48ad-8ace-578b0360b9d7 req-7a3b5e97-85da-4f2d-b05d-da01be91755c tempest-VolumesSnapshotsTestJSON-1523483912 None] Lock "cinder-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f8d0ca40-04ab-49d1-b2dd-15f36800eaa5 tempest-SnapshotsActionsTest-763119705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.65ce1d4c-9937-45e3-8ddd-d7d14a97c2e7" returned: 0 in 0.534s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:10 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-f8d0ca40-04ab-49d1-b2dd-15f36800eaa5 tempest-SnapshotsActionsTest-763119705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-190ad25c-e138-4140-b5ff-db156e59fc6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:07:10 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ccdcf8-083a-44c2-bff0-4a88aaa32e5d]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f8d0ca40-04ab-49d1-b2dd-15f36800eaa5 tempest-SnapshotsActionsTest-763119705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:10 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-846e9cde-266f-48ad-8ace-578b0360b9d7 req-7a3b5e97-85da-4f2d-b05d-da01be91755c tempest-VolumesSnapshotsTestJSON-1523483912 None] Acquiring lock "cinder-quobyte-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:10 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-846e9cde-266f-48ad-8ace-578b0360b9d7 req-7a3b5e97-85da-4f2d-b05d-da01be91755c tempest-VolumesSnapshotsTestJSON-1523483912 None] Lock "cinder-quobyte-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95" acquired by "delete_volume" :: waited 0.033s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:10 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c26fc65-eb3c-493a-8bfb-a05cffdf8508]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-846e9cde-266f-48ad-8ace-578b0360b9d7 req-7a3b5e97-85da-4f2d-b05d-da01be91755c tempest-VolumesSnapshotsTestJSON-1523483912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:10 devstack sudo[92960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 Sep 28 18:07:10 devstack sudo[92960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:10 devstack sudo[92963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95 Sep 28 18:07:10 devstack sudo[92963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:11 devstack sudo[92960]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f8d0ca40-04ab-49d1-b2dd-15f36800eaa5 tempest-SnapshotsActionsTest-763119705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708" returned: 0 in 0.662s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:11 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-f8d0ca40-04ab-49d1-b2dd-15f36800eaa5 tempest-SnapshotsActionsTest-763119705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-190ad25c-e138-4140-b5ff-db156e59fc6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:07:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f8d0ca40-04ab-49d1-b2dd-15f36800eaa5 tempest-SnapshotsActionsTest-763119705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.65ce1d4c-9937-45e3-8ddd-d7d14a97c2e7 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:11 devstack sudo[92971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.65ce1d4c-9937-45e3-8ddd-d7d14a97c2e7 Sep 28 18:07:11 devstack sudo[92971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:11 devstack sudo[92963]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-846e9cde-266f-48ad-8ace-578b0360b9d7 req-7a3b5e97-85da-4f2d-b05d-da01be91755c tempest-VolumesSnapshotsTestJSON-1523483912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95" returned: 0 in 0.637s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-846e9cde-266f-48ad-8ace-578b0360b9d7 req-7a3b5e97-85da-4f2d-b05d-da01be91755c tempest-VolumesSnapshotsTestJSON-1523483912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:11 devstack sudo[92975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95 Sep 28 18:07:11 devstack sudo[92975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:11 devstack sudo[92975]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-846e9cde-266f-48ad-8ace-578b0360b9d7 req-7a3b5e97-85da-4f2d-b05d-da01be91755c tempest-VolumesSnapshotsTestJSON-1523483912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95" returned: 0 in 0.495s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:11 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-846e9cde-266f-48ad-8ace-578b0360b9d7 req-7a3b5e97-85da-4f2d-b05d-da01be91755c tempest-VolumesSnapshotsTestJSON-1523483912 None] Lock "cinder-quobyte-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95" released by "delete_volume" :: held 1.239s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:11 devstack sudo[92971]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f8d0ca40-04ab-49d1-b2dd-15f36800eaa5 tempest-SnapshotsActionsTest-763119705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.65ce1d4c-9937-45e3-8ddd-d7d14a97c2e7" returned: 0 in 0.687s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f8d0ca40-04ab-49d1-b2dd-15f36800eaa5 tempest-SnapshotsActionsTest-763119705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.65ce1d4c-9937-45e3-8ddd-d7d14a97c2e7 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:11 devstack sudo[92986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.65ce1d4c-9937-45e3-8ddd-d7d14a97c2e7 Sep 28 18:07:11 devstack sudo[92986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:11 devstack cinder-volume[86980]: DEBUG cinder.quota [req-846e9cde-266f-48ad-8ace-578b0360b9d7 req-7a3b5e97-85da-4f2d-b05d-da01be91755c tempest-VolumesSnapshotsTestJSON-1523483912 None] Created reservations ['8d9ebc47-8800-4eac-9b49-4328defa4e90', 'f8128325-f57e-40e7-a685-4abfe8f33091', '50218b62-2415-4c24-9b54-cc386526a87b', '653a7b4d-be5d-4ff4-85b3-be2f109aef3d'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:07:11 devstack sudo[92939]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_v5v5huiedevstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55ec1b80-13ff-430a-8431-4e46a2ff9441" returned: 0 in 3.137s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:11 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_v5v5huiedevstack@QuobyteHD, size 112.00 MB, duration 3.14 sec, destination /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55ec1b80-13ff-430a-8431-4e46a2ff9441 {{(pid=86980) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:07:11 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Converted 112.00 MB image at 35.69 MB/s Sep 28 18:07:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55ec1b80-13ff-430a-8431-4e46a2ff9441 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:12 devstack sudo[92991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55ec1b80-13ff-430a-8431-4e46a2ff9441 1G Sep 28 18:07:12 devstack sudo[92991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-846e9cde-266f-48ad-8ace-578b0360b9d7 req-7a3b5e97-85da-4f2d-b05d-da01be91755c tempest-VolumesSnapshotsTestJSON-1523483912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-846e9cde-266f-48ad-8ace-578b0360b9d7 req-7a3b5e97-85da-4f2d-b05d-da01be91755c tempest-VolumesSnapshotsTestJSON-1523483912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:12 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [req-846e9cde-266f-48ad-8ace-578b0360b9d7 req-7a3b5e97-85da-4f2d-b05d-da01be91755c tempest-VolumesSnapshotsTestJSON-1523483912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:12 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [req-846e9cde-266f-48ad-8ace-578b0360b9d7 req-7a3b5e97-85da-4f2d-b05d-da01be91755c tempest-VolumesSnapshotsTestJSON-1523483912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-846e9cde-266f-48ad-8ace-578b0360b9d7 req-7a3b5e97-85da-4f2d-b05d-da01be91755c tempest-VolumesSnapshotsTestJSON-1523483912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-846e9cde-266f-48ad-8ace-578b0360b9d7 req-7a3b5e97-85da-4f2d-b05d-da01be91755c tempest-VolumesSnapshotsTestJSON-1523483912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:12 devstack sudo[92997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:07:12 devstack sudo[92997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:12 devstack sudo[92986]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f8d0ca40-04ab-49d1-b2dd-15f36800eaa5 tempest-SnapshotsActionsTest-763119705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.65ce1d4c-9937-45e3-8ddd-d7d14a97c2e7" returned: 0 in 0.684s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:12 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f8d0ca40-04ab-49d1-b2dd-15f36800eaa5 tempest-SnapshotsActionsTest-763119705 None] Lock "cinder-quobyte-65ce1d4c-9937-45e3-8ddd-d7d14a97c2e7" released by "_delete_snapshot" :: held 2.753s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:12 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f8d0ca40-04ab-49d1-b2dd-15f36800eaa5 tempest-SnapshotsActionsTest-763119705 None] Lock "cinder-quobyte-190ad25c-e138-4140-b5ff-db156e59fc6d" released by "delete_snapshot" :: held 2.809s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:12 devstack sudo[92991]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55ec1b80-13ff-430a-8431-4e46a2ff9441 1G" returned: 0 in 0.581s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:12 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Downloaded image d5838d4d-ebb7-4d18-8c3c-fc660c294083 ((None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}])) to volume 55ec1b80-13ff-430a-8431-4e46a2ff9441 successfully. {{(pid=86980) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:07:12 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Temporary image d5838d4d-ebb7-4d18-8c3c-fc660c294083 for user cd198dd8e13546c9a4aeda280a7a02d7 is deleted. {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:07:12 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Marking volume 55ec1b80-13ff-430a-8431-4e46a2ff9441 as bootable. {{(pid=86980) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:07:12 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Copying metadata from image d5838d4d-ebb7-4d18-8c3c-fc660c294083 to 55ec1b80-13ff-430a-8431-4e46a2ff9441. {{(pid=86980) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:07:12 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Creating volume glance metadata for volume 55ec1b80-13ff-430a-8431-4e46a2ff9441 backed by image d5838d4d-ebb7-4d18-8c3c-fc660c294083 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86980) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:07:12 devstack sudo[92997]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-846e9cde-266f-48ad-8ace-578b0360b9d7 req-7a3b5e97-85da-4f2d-b05d-da01be91755c tempest-VolumesSnapshotsTestJSON-1523483912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.607s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:12 devstack cinder-volume[86980]: DEBUG cinder.manager [req-846e9cde-266f-48ad-8ace-578b0360b9d7 req-7a3b5e97-85da-4f2d-b05d-da01be91755c tempest-VolumesSnapshotsTestJSON-1523483912 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:07:12 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-846e9cde-266f-48ad-8ace-578b0360b9d7 req-7a3b5e97-85da-4f2d-b05d-da01be91755c tempest-VolumesSnapshotsTestJSON-1523483912 None] Deleted volume successfully. Sep 28 18:07:12 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-f8d0ca40-04ab-49d1-b2dd-15f36800eaa5 tempest-SnapshotsActionsTest-763119705 None] Created reservations ['700a36ed-3d11-4744-b508-f976049f6e46', '2508b482-8041-48d0-bb1e-30d626da84b9', '93e35483-48eb-448f-a55a-f4a422586f46', 'd0d4fb7f-6928-45bd-aad7-6f3eb7417b8e'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:07:13 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c34a1c-83d0-444a-8f5c-102cb1f1fa87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55ec1b80-13ff-430a-8431-4e46a2ff9441', 'volume_size': 1, 'image_id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c13a4cea8f714bb0b9012709acb9372b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'created_at': datetime.datetime(2026, 9, 28, 15, 57, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 57, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:13 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (702ebfe3-38c2-454b-9526-4c6b7e699854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:13 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-846e9cde-266f-48ad-8ace-578b0360b9d7 req-7a3b5e97-85da-4f2d-b05d-da01be91755c tempest-VolumesSnapshotsTestJSON-1523483912 None] Lock "cinder-2c3af854-0f3a-4fbf-9ba8-65b24d2dcb95-delete_volume" released by "delete_volume" :: held 2.759s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:13 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Volume volume-55ec1b80-13ff-430a-8431-4e46a2ff9441 (55ec1b80-13ff-430a-8431-4e46a2ff9441): created successfully Sep 28 18:07:13 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (702ebfe3-38c2-454b-9526-4c6b7e699854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:13 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Flow 'volume_create_manager' (11c2d104-b588-43f9-b967-dc3363a1dae2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:07:13 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-404c0601-6d30-4095-ae51-075f17d869bd tempest-ServerActionsTestOtherA-1750096549 None] Created volume successfully. Sep 28 18:07:13 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-f8d0ca40-04ab-49d1-b2dd-15f36800eaa5 tempest-SnapshotsActionsTest-763119705 None] Delete snapshot completed successfully. Sep 28 18:07:13 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f8d0ca40-04ab-49d1-b2dd-15f36800eaa5 tempest-SnapshotsActionsTest-763119705 None] Lock "cinder-65ce1d4c-9937-45e3-8ddd-d7d14a97c2e7-delete_snapshot" released by "delete_snapshot" :: held 3.531s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:14 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f68886c7-0356-4b6c-a1ae-f9798dcb0b58 tempest-SnapshotsActionsTest-1278071978 None] Acquiring lock "cinder-1a76e5d0-7875-4865-8ef0-c679a5a6b708-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:14 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f68886c7-0356-4b6c-a1ae-f9798dcb0b58 tempest-SnapshotsActionsTest-1278071978 None] Lock "cinder-1a76e5d0-7875-4865-8ef0-c679a5a6b708-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:14 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f68886c7-0356-4b6c-a1ae-f9798dcb0b58 tempest-SnapshotsActionsTest-1278071978 None] Acquiring lock "cinder-quobyte-190ad25c-e138-4140-b5ff-db156e59fc6d" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:14 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f68886c7-0356-4b6c-a1ae-f9798dcb0b58 tempest-SnapshotsActionsTest-1278071978 None] Lock "cinder-quobyte-190ad25c-e138-4140-b5ff-db156e59fc6d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:14 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f68886c7-0356-4b6c-a1ae-f9798dcb0b58 tempest-SnapshotsActionsTest-1278071978 None] Acquiring lock "cinder-quobyte-1a76e5d0-7875-4865-8ef0-c679a5a6b708" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:14 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f68886c7-0356-4b6c-a1ae-f9798dcb0b58 tempest-SnapshotsActionsTest-1278071978 None] Lock "cinder-quobyte-1a76e5d0-7875-4865-8ef0-c679a5a6b708" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:14 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-f68886c7-0356-4b6c-a1ae-f9798dcb0b58 tempest-SnapshotsActionsTest-1278071978 None] Deleting offline snapshot 1a76e5d0-7875-4865-8ef0-c679a5a6b708 of volume 190ad25c-e138-4140-b5ff-db156e59fc6d {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:07:14 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-f68886c7-0356-4b6c-a1ae-f9798dcb0b58 tempest-SnapshotsActionsTest-1278071978 None] snapshot_file for this snap is: volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:07:14 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[870d98a0-3402-4f7d-9681-17179fe426ec]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f68886c7-0356-4b6c-a1ae-f9798dcb0b58 tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:14 devstack sudo[93018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 Sep 28 18:07:14 devstack sudo[93018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:15 devstack sudo[93018]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f68886c7-0356-4b6c-a1ae-f9798dcb0b58 tempest-SnapshotsActionsTest-1278071978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708" returned: 0 in 0.451s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:15 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-f68886c7-0356-4b6c-a1ae-f9798dcb0b58 tempest-SnapshotsActionsTest-1278071978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-190ad25c-e138-4140-b5ff-db156e59fc6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:07:15 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f192fa2-0b4f-410f-9822-f9dce9dc7923]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f68886c7-0356-4b6c-a1ae-f9798dcb0b58 tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:15 devstack sudo[93023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d Sep 28 18:07:15 devstack sudo[93023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:15 devstack sudo[93023]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f68886c7-0356-4b6c-a1ae-f9798dcb0b58 tempest-SnapshotsActionsTest-1278071978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d" returned: 0 in 0.483s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f68886c7-0356-4b6c-a1ae-f9798dcb0b58 tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:15 devstack sudo[93029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 Sep 28 18:07:15 devstack sudo[93029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:16 devstack sudo[93029]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f68886c7-0356-4b6c-a1ae-f9798dcb0b58 tempest-SnapshotsActionsTest-1278071978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708" returned: 0 in 0.689s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f68886c7-0356-4b6c-a1ae-f9798dcb0b58 tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:16 devstack sudo[93047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708 Sep 28 18:07:16 devstack sudo[93047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:16 devstack sudo[93047]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f68886c7-0356-4b6c-a1ae-f9798dcb0b58 tempest-SnapshotsActionsTest-1278071978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d.1a76e5d0-7875-4865-8ef0-c679a5a6b708" returned: 0 in 0.477s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:17 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f68886c7-0356-4b6c-a1ae-f9798dcb0b58 tempest-SnapshotsActionsTest-1278071978 None] Lock "cinder-quobyte-1a76e5d0-7875-4865-8ef0-c679a5a6b708" released by "_delete_snapshot" :: held 2.316s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:17 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f68886c7-0356-4b6c-a1ae-f9798dcb0b58 tempest-SnapshotsActionsTest-1278071978 None] Lock "cinder-quobyte-190ad25c-e138-4140-b5ff-db156e59fc6d" released by "delete_snapshot" :: held 2.350s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:17 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-f68886c7-0356-4b6c-a1ae-f9798dcb0b58 tempest-SnapshotsActionsTest-1278071978 None] Created reservations ['f18a8a44-3e37-4cca-b171-04674364dba3', 'e319748e-8ad5-4665-9170-c08a9987c696', 'a3937eb1-0ff5-45e4-91c1-bb431bee03eb', 'e4aa66c9-0afd-40a1-b885-6a9c37113f12'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:07:17 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-f68886c7-0356-4b6c-a1ae-f9798dcb0b58 tempest-SnapshotsActionsTest-1278071978 None] Delete snapshot completed successfully. Sep 28 18:07:17 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f68886c7-0356-4b6c-a1ae-f9798dcb0b58 tempest-SnapshotsActionsTest-1278071978 None] Lock "cinder-1a76e5d0-7875-4865-8ef0-c679a5a6b708-delete_snapshot" released by "delete_snapshot" :: held 2.686s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b9a71dc9-aa5c-418e-bce0-0a42d11d5c59 tempest-SnapshotsActionsTest-1278071978 None] Acquiring lock "cinder-190ad25c-e138-4140-b5ff-db156e59fc6d-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b9a71dc9-aa5c-418e-bce0-0a42d11d5c59 tempest-SnapshotsActionsTest-1278071978 None] Lock "cinder-190ad25c-e138-4140-b5ff-db156e59fc6d-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b9a71dc9-aa5c-418e-bce0-0a42d11d5c59 tempest-SnapshotsActionsTest-1278071978 None] Acquiring lock "cinder-quobyte-190ad25c-e138-4140-b5ff-db156e59fc6d" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b9a71dc9-aa5c-418e-bce0-0a42d11d5c59 tempest-SnapshotsActionsTest-1278071978 None] Lock "cinder-quobyte-190ad25c-e138-4140-b5ff-db156e59fc6d" acquired by "delete_volume" :: waited 0.026s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:18 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c275d5dc-07fa-410b-84d0-1d9c784e97d2]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b9a71dc9-aa5c-418e-bce0-0a42d11d5c59 tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:18 devstack sudo[93122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d Sep 28 18:07:18 devstack sudo[93122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:19 devstack sudo[93122]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b9a71dc9-aa5c-418e-bce0-0a42d11d5c59 tempest-SnapshotsActionsTest-1278071978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d" returned: 0 in 0.683s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b9a71dc9-aa5c-418e-bce0-0a42d11d5c59 tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:19 devstack sudo[93127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d Sep 28 18:07:19 devstack sudo[93127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:19 devstack sudo[93127]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b9a71dc9-aa5c-418e-bce0-0a42d11d5c59 tempest-SnapshotsActionsTest-1278071978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-190ad25c-e138-4140-b5ff-db156e59fc6d" returned: 0 in 0.518s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:19 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b9a71dc9-aa5c-418e-bce0-0a42d11d5c59 tempest-SnapshotsActionsTest-1278071978 None] Lock "cinder-quobyte-190ad25c-e138-4140-b5ff-db156e59fc6d" released by "delete_volume" :: held 1.360s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:19 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-b9a71dc9-aa5c-418e-bce0-0a42d11d5c59 tempest-SnapshotsActionsTest-1278071978 None] Created reservations ['dee46dfa-84ea-4d08-a65e-383b269092d6', 'ff44a3c2-673e-4c29-81d0-e8521d0d0660', 'cd64841a-23da-4dc5-b7ec-f8db9ba15413', 'd6f003fd-8579-4705-8686-8ca5dc8438a2'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:07:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b9a71dc9-aa5c-418e-bce0-0a42d11d5c59 tempest-SnapshotsActionsTest-1278071978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b9a71dc9-aa5c-418e-bce0-0a42d11d5c59 tempest-SnapshotsActionsTest-1278071978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:20 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b9a71dc9-aa5c-418e-bce0-0a42d11d5c59 tempest-SnapshotsActionsTest-1278071978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:20 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b9a71dc9-aa5c-418e-bce0-0a42d11d5c59 tempest-SnapshotsActionsTest-1278071978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b9a71dc9-aa5c-418e-bce0-0a42d11d5c59 tempest-SnapshotsActionsTest-1278071978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b9a71dc9-aa5c-418e-bce0-0a42d11d5c59 tempest-SnapshotsActionsTest-1278071978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:20 devstack sudo[93140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:07:20 devstack sudo[93140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-108bf4c8-1d25-41f0-91d4-71a1f9831f9c req-561b4ae6-0f7e-4c4c-81e1-84a517df24b3 tempest-ServerActionsTestOtherA-1750096549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-108bf4c8-1d25-41f0-91d4-71a1f9831f9c req-561b4ae6-0f7e-4c4c-81e1-84a517df24b3 tempest-ServerActionsTestOtherA-1750096549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-108bf4c8-1d25-41f0-91d4-71a1f9831f9c req-561b4ae6-0f7e-4c4c-81e1-84a517df24b3 tempest-ServerActionsTestOtherA-1750096549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-108bf4c8-1d25-41f0-91d4-71a1f9831f9c req-561b4ae6-0f7e-4c4c-81e1-84a517df24b3 tempest-ServerActionsTestOtherA-1750096549 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729', 'name': 'volume-55ec1b80-13ff-430a-8431-4e46a2ff9441', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aeb17307-a6bc-4258-85d4-985b1ac4db11', 'enforce_multipath': True} {{(pid=86980) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:07:21 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-108bf4c8-1d25-41f0-91d4-71a1f9831f9c req-561b4ae6-0f7e-4c4c-81e1-84a517df24b3 tempest-ServerActionsTestOtherA-1750096549 None] attachment_update completed successfully. Sep 28 18:07:21 devstack sudo[93140]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b9a71dc9-aa5c-418e-bce0-0a42d11d5c59 tempest-SnapshotsActionsTest-1278071978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.814s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:21 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-b9a71dc9-aa5c-418e-bce0-0a42d11d5c59 tempest-SnapshotsActionsTest-1278071978 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:07:21 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-b9a71dc9-aa5c-418e-bce0-0a42d11d5c59 tempest-SnapshotsActionsTest-1278071978 None] Deleted volume successfully. Sep 28 18:07:21 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b9a71dc9-aa5c-418e-bce0-0a42d11d5c59 tempest-SnapshotsActionsTest-1278071978 None] Lock "cinder-190ad25c-e138-4140-b5ff-db156e59fc6d-delete_volume" released by "delete_volume" :: held 2.812s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:30 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=107,cinder:INSERT=35,cinder:UPDATE=91,cinder:DELETE=8 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:07:31 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:UPDATE=108,cinder:SELECT=85,cinder:DELETE=7,cinder:INSERT=31 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:07:34 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-78efb48e-dc62-4ff5-ac77-f7ce16dec5f6 tempest-GroupsTest-881750182 None] Group tempest-Group1-8219286: creating Sep 28 18:07:34 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-78efb48e-dc62-4ff5-ac77-f7ce16dec5f6 tempest-GroupsTest-881750182 None] Group tempest-Group1-8219286: created successfully Sep 28 18:07:34 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-78efb48e-dc62-4ff5-ac77-f7ce16dec5f6 tempest-GroupsTest-881750182 None] Create group completed successfully. Sep 28 18:07:36 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-4ba7acbb-2b0a-47bd-882e-5efcbbcda25e tempest-GroupsTest-881750182 None] Group tempest-Group2-195833909: creating Sep 28 18:07:36 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-4ba7acbb-2b0a-47bd-882e-5efcbbcda25e tempest-GroupsTest-881750182 None] Group tempest-Group2-195833909: created successfully Sep 28 18:07:36 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-4ba7acbb-2b0a-47bd-882e-5efcbbcda25e tempest-GroupsTest-881750182 None] Create group completed successfully. Sep 28 18:07:36 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:07:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Flow 'volume_create_manager' (27b6b236-a21c-40bd-81e1-6ca7cd23e791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:07:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0660b2dd-980d-4742-97b4-e980d4efe739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0660b2dd-980d-4742-97b4-e980d4efe739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1787166318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adad24f9-2152-4186-a0df-3c676489b50e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f323bfdf07f417da0edb19e00579ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:36Z,use_quota=True,user_id='c48825f7570547dea030ce93cc13cb2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2956bd4d-dacc-45ba-89a8-1856265bf551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2956bd4d-dacc-45ba-89a8-1856265bf551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05b43e9e-196b-46f6-bf9e-680aebe28d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05b43e9e-196b-46f6-bf9e-680aebe28d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adad24f9-2152-4186-a0df-3c676489b50e', 'volume_name': 'volume-adad24f9-2152-4186-a0df-3c676489b50e', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7966a9-d733-4f48-bb11-4d534da96995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7966a9-d733-4f48-bb11-4d534da96995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e98fe6-9ded-4ea5-9000-41c1479c8466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:36 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Volume adad24f9-2152-4186-a0df-3c676489b50e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adad24f9-2152-4186-a0df-3c676489b50e', 'volume_size': 1} Sep 28 18:07:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1787166318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adad24f9-2152-4186-a0df-3c676489b50e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f323bfdf07f417da0edb19e00579ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:36Z,use_quota=True,user_id='c48825f7570547dea030ce93cc13cb2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:07:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Creating volume adad24f9-2152-4186-a0df-3c676489b50e {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:07:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:07:36 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:07:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-adad24f9-2152-4186-a0df-3c676489b50e 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:36 devstack sudo[93685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-adad24f9-2152-4186-a0df-3c676489b50e 1073741824 Sep 28 18:07:36 devstack sudo[93685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:37 devstack sudo[93685]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-adad24f9-2152-4186-a0df-3c676489b50e 1073741824" returned: 0 in 1.142s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-adad24f9-2152-4186-a0df-3c676489b50e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:37 devstack sudo[93711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-adad24f9-2152-4186-a0df-3c676489b50e Sep 28 18:07:37 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:38 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-adad24f9-2152-4186-a0df-3c676489b50e" returned: 0 in 0.614s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:07:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e98fe6-9ded-4ea5-9000-41c1479c8466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adad24f9-2152-4186-a0df-3c676489b50e', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78116a0b-f988-4584-afd6-9f3cf600412c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:38 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Volume volume-adad24f9-2152-4186-a0df-3c676489b50e (adad24f9-2152-4186-a0df-3c676489b50e): created successfully Sep 28 18:07:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78116a0b-f988-4584-afd6-9f3cf600412c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Flow 'volume_create_manager' (27b6b236-a21c-40bd-81e1-6ca7cd23e791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:07:38 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-e6e5c164-7c56-4a22-8604-e78061073bff tempest-VolumesServicesTestJSON-326075176 None] Created volume successfully. Sep 28 18:07:39 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:07:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Flow 'volume_create_manager' (131fce54-7ed5-49f1-a6ce-5d14fc292b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:07:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1be6149b-13e1-4e74-b778-85224cd88640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4b44c2ca-faef-4006-b485-482346f3954e tempest-VolumesServicesTestJSON-326075176 None] Acquiring lock "cinder-adad24f9-2152-4186-a0df-3c676489b50e-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4b44c2ca-faef-4006-b485-482346f3954e tempest-VolumesServicesTestJSON-326075176 None] Lock "cinder-adad24f9-2152-4186-a0df-3c676489b50e-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1be6149b-13e1-4e74-b778-85224cd88640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1279081711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0622210a-3070-46a9-9398-27af05a3c7fc,host='devstack@QuobyteHD#QuobyteHD',id=e02738e1-c03f-4ef5-9a72-e3617d852f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edf133b52f9a4ba29bf4835e762e2f39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:39Z,use_quota=True,user_id='d237114b4609425d829eb33707bb643d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d680d0d-90e6-4245-8f85-8dbccbbd78f3),volume_type_id=1d680d0d-90e6-4245-8f85-8dbccbbd78f3)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d80b3cfd-2ed7-480c-a46a-6bb7f83e553a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d80b3cfd-2ed7-480c-a46a-6bb7f83e553a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a784c5de-6c0c-449b-9be2-81314b7a1b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a784c5de-6c0c-449b-9be2-81314b7a1b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e02738e1-c03f-4ef5-9a72-e3617d852f9d', 'volume_name': 'volume-e02738e1-c03f-4ef5-9a72-e3617d852f9d', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e81af3c-793d-4bf6-923d-fc97ec3d2b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e81af3c-793d-4bf6-923d-fc97ec3d2b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad965b0-0440-436b-8751-b6feb1e2db3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:39 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Volume e02738e1-c03f-4ef5-9a72-e3617d852f9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e02738e1-c03f-4ef5-9a72-e3617d852f9d', 'volume_size': 1} Sep 28 18:07:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0622210a-3070-46a9-9398-27af05a3c7fc,created_at=2026-09-28T16:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1279081711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0622210a-3070-46a9-9398-27af05a3c7fc,host='devstack@QuobyteHD#QuobyteHD',id=e02738e1-c03f-4ef5-9a72-e3617d852f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edf133b52f9a4ba29bf4835e762e2f39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:39Z,use_quota=True,user_id='d237114b4609425d829eb33707bb643d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d680d0d-90e6-4245-8f85-8dbccbbd78f3),volume_type_id=1d680d0d-90e6-4245-8f85-8dbccbbd78f3)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:07:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Creating volume e02738e1-c03f-4ef5-9a72-e3617d852f9d {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:07:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:07:39 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:07:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e02738e1-c03f-4ef5-9a72-e3617d852f9d 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:39 devstack sudo[93735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e02738e1-c03f-4ef5-9a72-e3617d852f9d 1073741824 Sep 28 18:07:39 devstack sudo[93735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4b44c2ca-faef-4006-b485-482346f3954e tempest-VolumesServicesTestJSON-326075176 None] Acquiring lock "cinder-quobyte-adad24f9-2152-4186-a0df-3c676489b50e" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4b44c2ca-faef-4006-b485-482346f3954e tempest-VolumesServicesTestJSON-326075176 None] Lock "cinder-quobyte-adad24f9-2152-4186-a0df-3c676489b50e" acquired by "delete_volume" :: waited 0.074s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:40 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9821a09-14f2-439e-b4ee-41b053b499f9]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4b44c2ca-faef-4006-b485-482346f3954e tempest-VolumesServicesTestJSON-326075176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-adad24f9-2152-4186-a0df-3c676489b50e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:40 devstack sudo[93744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-adad24f9-2152-4186-a0df-3c676489b50e Sep 28 18:07:40 devstack sudo[93744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:40 devstack sudo[93735]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e02738e1-c03f-4ef5-9a72-e3617d852f9d 1073741824" returned: 0 in 1.091s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:40 devstack sudo[93744]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4b44c2ca-faef-4006-b485-482346f3954e tempest-VolumesServicesTestJSON-326075176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-adad24f9-2152-4186-a0df-3c676489b50e" returned: 0 in 0.834s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4b44c2ca-faef-4006-b485-482346f3954e tempest-VolumesServicesTestJSON-326075176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-adad24f9-2152-4186-a0df-3c676489b50e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e02738e1-c03f-4ef5-9a72-e3617d852f9d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:40 devstack sudo[93766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-adad24f9-2152-4186-a0df-3c676489b50e Sep 28 18:07:40 devstack sudo[93766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:40 devstack sudo[93768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e02738e1-c03f-4ef5-9a72-e3617d852f9d Sep 28 18:07:40 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:41 devstack sudo[93766]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4b44c2ca-faef-4006-b485-482346f3954e tempest-VolumesServicesTestJSON-326075176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-adad24f9-2152-4186-a0df-3c676489b50e" returned: 0 in 0.486s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4b44c2ca-faef-4006-b485-482346f3954e tempest-VolumesServicesTestJSON-326075176 None] Lock "cinder-quobyte-adad24f9-2152-4186-a0df-3c676489b50e" released by "delete_volume" :: held 1.451s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:41 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e02738e1-c03f-4ef5-9a72-e3617d852f9d" returned: 0 in 0.592s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:41 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:07:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad965b0-0440-436b-8751-b6feb1e2db3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e02738e1-c03f-4ef5-9a72-e3617d852f9d', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e443da-9d31-4c60-bf8a-318d27eeedef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:41 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-4b44c2ca-faef-4006-b485-482346f3954e tempest-VolumesServicesTestJSON-326075176 None] Created reservations ['77373628-970c-41e5-b504-9a8a5a580324', 'af9a5a24-a714-4b3b-91e8-2ab52cda145d', '44d1bda9-9265-460c-9fb2-9853805ba6d7', '5c60a0d7-e336-4474-9e79-70ee2631f3ff'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:07:41 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Volume volume-e02738e1-c03f-4ef5-9a72-e3617d852f9d (e02738e1-c03f-4ef5-9a72-e3617d852f9d): created successfully Sep 28 18:07:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e443da-9d31-4c60-bf8a-318d27eeedef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Flow 'volume_create_manager' (131fce54-7ed5-49f1-a6ce-5d14fc292b70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:07:41 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-83d98274-174d-40f0-a8e1-01f3edd31df7 tempest-GroupsTest-881750182 None] Created volume successfully. Sep 28 18:07:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4b44c2ca-faef-4006-b485-482346f3954e tempest-VolumesServicesTestJSON-326075176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4b44c2ca-faef-4006-b485-482346f3954e tempest-VolumesServicesTestJSON-326075176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:41 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4b44c2ca-faef-4006-b485-482346f3954e tempest-VolumesServicesTestJSON-326075176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:41 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4b44c2ca-faef-4006-b485-482346f3954e tempest-VolumesServicesTestJSON-326075176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4b44c2ca-faef-4006-b485-482346f3954e tempest-VolumesServicesTestJSON-326075176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4b44c2ca-faef-4006-b485-482346f3954e tempest-VolumesServicesTestJSON-326075176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:41 devstack sudo[93772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:07:41 devstack sudo[93772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:42 devstack sudo[93772]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4b44c2ca-faef-4006-b485-482346f3954e tempest-VolumesServicesTestJSON-326075176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 1.078s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:42 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-4b44c2ca-faef-4006-b485-482346f3954e tempest-VolumesServicesTestJSON-326075176 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:07:42 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-4b44c2ca-faef-4006-b485-482346f3954e tempest-VolumesServicesTestJSON-326075176 None] Deleted volume successfully. Sep 28 18:07:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4b44c2ca-faef-4006-b485-482346f3954e tempest-VolumesServicesTestJSON-326075176 None] Lock "cinder-adad24f9-2152-4186-a0df-3c676489b50e-delete_volume" released by "delete_volume" :: held 3.428s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:45 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6e773643-4871-4b5b-8895-92165f3c7eeb tempest-GroupsTest-881750182 None] Acquiring lock "cinder-quobyte-e02738e1-c03f-4ef5-9a72-e3617d852f9d" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:07:45 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6e773643-4871-4b5b-8895-92165f3c7eeb tempest-GroupsTest-881750182 None] Lock "cinder-quobyte-e02738e1-c03f-4ef5-9a72-e3617d852f9d" acquired by "delete_volume" :: waited 0.043s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:07:45 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35cbd34-4f03-4e0f-8ed5-805406eaab33]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:07:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6e773643-4871-4b5b-8895-92165f3c7eeb tempest-GroupsTest-881750182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e02738e1-c03f-4ef5-9a72-e3617d852f9d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:46 devstack sudo[93817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e02738e1-c03f-4ef5-9a72-e3617d852f9d Sep 28 18:07:46 devstack sudo[93817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:46 devstack sudo[93817]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6e773643-4871-4b5b-8895-92165f3c7eeb tempest-GroupsTest-881750182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e02738e1-c03f-4ef5-9a72-e3617d852f9d" returned: 0 in 0.971s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6e773643-4871-4b5b-8895-92165f3c7eeb tempest-GroupsTest-881750182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e02738e1-c03f-4ef5-9a72-e3617d852f9d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:47 devstack sudo[93869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e02738e1-c03f-4ef5-9a72-e3617d852f9d Sep 28 18:07:47 devstack sudo[93869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:47 devstack sudo[93869]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6e773643-4871-4b5b-8895-92165f3c7eeb tempest-GroupsTest-881750182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e02738e1-c03f-4ef5-9a72-e3617d852f9d" returned: 0 in 0.645s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6e773643-4871-4b5b-8895-92165f3c7eeb tempest-GroupsTest-881750182 None] Lock "cinder-quobyte-e02738e1-c03f-4ef5-9a72-e3617d852f9d" released by "delete_volume" :: held 1.731s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:07:47 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-6e773643-4871-4b5b-8895-92165f3c7eeb tempest-GroupsTest-881750182 None] Created reservations ['3bad62c9-0d3a-476f-b532-b7e27a65b467'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:07:47 devstack cinder-volume[86980]: WARNING cinder.quota [None req-6e773643-4871-4b5b-8895-92165f3c7eeb tempest-GroupsTest-881750182 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-467666856 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-467666856, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:07:47 devstack cinder-volume[86980]: WARNING cinder.quota [None req-6e773643-4871-4b5b-8895-92165f3c7eeb tempest-GroupsTest-881750182 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-467666856 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-467666856, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:07:47 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-6e773643-4871-4b5b-8895-92165f3c7eeb tempest-GroupsTest-881750182 None] Created reservations ['17da0eab-03dd-4e6f-980a-bcb176b9d79c', '9d0bc3eb-f733-4e6c-b1de-46db9398041d', 'dca85e1c-2354-4515-8a4e-ff8105d61d10', '24ec4597-2970-4763-8a89-9fe32d748055'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:07:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6e773643-4871-4b5b-8895-92165f3c7eeb tempest-GroupsTest-881750182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6e773643-4871-4b5b-8895-92165f3c7eeb tempest-GroupsTest-881750182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:48 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6e773643-4871-4b5b-8895-92165f3c7eeb tempest-GroupsTest-881750182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:48 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6e773643-4871-4b5b-8895-92165f3c7eeb tempest-GroupsTest-881750182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6e773643-4871-4b5b-8895-92165f3c7eeb tempest-GroupsTest-881750182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6e773643-4871-4b5b-8895-92165f3c7eeb tempest-GroupsTest-881750182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:48 devstack sudo[93879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:07:48 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:48 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6e773643-4871-4b5b-8895-92165f3c7eeb tempest-GroupsTest-881750182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.591s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:48 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6e773643-4871-4b5b-8895-92165f3c7eeb tempest-GroupsTest-881750182 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:07:48 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-6e773643-4871-4b5b-8895-92165f3c7eeb tempest-GroupsTest-881750182 None] Delete group completed successfully. Sep 28 18:07:49 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-fa912af1-4b3a-4966-a377-226660a58f9e tempest-GroupsTest-881750182 None] Created reservations ['639d4863-8500-49a8-97d9-f13993cfa520'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:07:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-fa912af1-4b3a-4966-a377-226660a58f9e tempest-GroupsTest-881750182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-fa912af1-4b3a-4966-a377-226660a58f9e tempest-GroupsTest-881750182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-fa912af1-4b3a-4966-a377-226660a58f9e tempest-GroupsTest-881750182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-fa912af1-4b3a-4966-a377-226660a58f9e tempest-GroupsTest-881750182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-fa912af1-4b3a-4966-a377-226660a58f9e tempest-GroupsTest-881750182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fa912af1-4b3a-4966-a377-226660a58f9e tempest-GroupsTest-881750182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:49 devstack sudo[93883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:07:49 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:49 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fa912af1-4b3a-4966-a377-226660a58f9e tempest-GroupsTest-881750182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.506s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:49 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-fa912af1-4b3a-4966-a377-226660a58f9e tempest-GroupsTest-881750182 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:07:49 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-fa912af1-4b3a-4966-a377-226660a58f9e tempest-GroupsTest-881750182 None] Delete group completed successfully. Sep 28 18:07:51 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-aeac5e5a-2ed8-4d3d-85c8-7810d83a850d tempest-GroupsTest-881750182 None] Group tempest-GroupsTest-Group-791226094: creating Sep 28 18:07:51 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-aeac5e5a-2ed8-4d3d-85c8-7810d83a850d tempest-GroupsTest-881750182 None] Group tempest-GroupsTest-Group-791226094: created successfully Sep 28 18:07:51 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-aeac5e5a-2ed8-4d3d-85c8-7810d83a850d tempest-GroupsTest-881750182 None] Create group completed successfully. Sep 28 18:07:53 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:07:53 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Flow 'volume_create_manager' (81c077ac-e12a-4e02-99f7-9111beaa2c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:07:53 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86eb7248-bd45-43a9-aa24-4217925f0a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:53 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86eb7248-bd45-43a9-aa24-4217925f0a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-995288950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f056b5-7285-4ba4-8be2-a383c824e12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3be6937831ce4b6cb5eec43c52bd41d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:54Z,use_quota=True,user_id='46247bd6c0f848d4be6559d1172d00c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:53 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d134d6-dd76-443b-9fa5-afc181665e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:53 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d134d6-dd76-443b-9fa5-afc181665e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:53 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd4cb1e-d227-43a1-9c4f-a87e9ae32d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:53 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd4cb1e-d227-43a1-9c4f-a87e9ae32d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36f056b5-7285-4ba4-8be2-a383c824e12b', 'volume_name': 'volume-36f056b5-7285-4ba4-8be2-a383c824e12b', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:53 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5ab1c44-fd16-4731-b824-5d0766e8e8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:53 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5ab1c44-fd16-4731-b824-5d0766e8e8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:53 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c4befc-244e-4a0a-bbfe-6dcd5d759e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:53 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Volume 36f056b5-7285-4ba4-8be2-a383c824e12b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36f056b5-7285-4ba4-8be2-a383c824e12b', 'volume_size': 1} Sep 28 18:07:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-995288950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f056b5-7285-4ba4-8be2-a383c824e12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3be6937831ce4b6cb5eec43c52bd41d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:54Z,use_quota=True,user_id='46247bd6c0f848d4be6559d1172d00c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:07:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Creating volume 36f056b5-7285-4ba4-8be2-a383c824e12b {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:07:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:07:53 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:07:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-36f056b5-7285-4ba4-8be2-a383c824e12b 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:53 devstack sudo[93894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-36f056b5-7285-4ba4-8be2-a383c824e12b 1073741824 Sep 28 18:07:53 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Flow 'volume_create_manager' (22eb7fec-2826-4682-a2ef-90f2fd69abe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c51ea9-0865-49b6-973d-fe7b588560b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c51ea9-0865-49b6-973d-fe7b588560b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1093552123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=14194096-5504-46e8-9998-331339acb838,host='devstack@QuobyteHD#QuobyteHD',id=f796a6dc-9d87-4507-a0b5-ab70c6b26afd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edf133b52f9a4ba29bf4835e762e2f39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:54Z,use_quota=True,user_id='d237114b4609425d829eb33707bb643d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(756b3410-f5ed-48a3-bb32-9d6d96951714),volume_type_id=756b3410-f5ed-48a3-bb32-9d6d96951714)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9bf151-2e94-4b63-9600-f73d5bf59f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9bf151-2e94-4b63-9600-f73d5bf59f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9506acf-7461-4428-ae76-e9202799fe29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9506acf-7461-4428-ae76-e9202799fe29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f796a6dc-9d87-4507-a0b5-ab70c6b26afd', 'volume_name': 'volume-f796a6dc-9d87-4507-a0b5-ab70c6b26afd', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e3b6c5-14fa-4375-9259-7486e214a698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e3b6c5-14fa-4375-9259-7486e214a698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb69a211-52a3-423e-9690-6348373065c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:54 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Volume f796a6dc-9d87-4507-a0b5-ab70c6b26afd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f796a6dc-9d87-4507-a0b5-ab70c6b26afd', 'volume_size': 1} Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-36f056b5-7285-4ba4-8be2-a383c824e12b 1073741824" returned: 0 in 0.713s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:54 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-36f056b5-7285-4ba4-8be2-a383c824e12b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:54 devstack sudo[93913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-36f056b5-7285-4ba4-8be2-a383c824e12b Sep 28 18:07:54 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:54 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-36f056b5-7285-4ba4-8be2-a383c824e12b" returned: 0 in 0.299s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.663s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=14194096-5504-46e8-9998-331339acb838,created_at=2026-09-28T16:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1093552123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=14194096-5504-46e8-9998-331339acb838,host='devstack@QuobyteHD#QuobyteHD',id=f796a6dc-9d87-4507-a0b5-ab70c6b26afd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edf133b52f9a4ba29bf4835e762e2f39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:54Z,use_quota=True,user_id='d237114b4609425d829eb33707bb643d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(756b3410-f5ed-48a3-bb32-9d6d96951714),volume_type_id=756b3410-f5ed-48a3-bb32-9d6d96951714)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Creating volume f796a6dc-9d87-4507-a0b5-ab70c6b26afd {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:07:54 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f796a6dc-9d87-4507-a0b5-ab70c6b26afd 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c4befc-244e-4a0a-bbfe-6dcd5d759e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36f056b5-7285-4ba4-8be2-a383c824e12b', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d5c276b-04af-4cb8-8f1d-d525b17a4919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:54 devstack sudo[93920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f796a6dc-9d87-4507-a0b5-ab70c6b26afd 1073741824 Sep 28 18:07:54 devstack sudo[93920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:54 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Volume volume-36f056b5-7285-4ba4-8be2-a383c824e12b (36f056b5-7285-4ba4-8be2-a383c824e12b): created successfully Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d5c276b-04af-4cb8-8f1d-d525b17a4919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Flow 'volume_create_manager' (81c077ac-e12a-4e02-99f7-9111beaa2c00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:07:54 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-a4a67726-3b68-4506-b877-7e07b7353369 tempest-ServersNegativeTestJSON-616355829 None] Created volume successfully. Sep 28 18:07:55 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-0dda7105-0541-475a-9e8b-7e1e6b61754f req-2816b4f1-864d-4ca3-a3cf-1995cb0a7086 tempest-ServerActionsTestOtherA-1750096549 None] Terminate volume connection completed successfully. Sep 28 18:07:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-0dda7105-0541-475a-9e8b-7e1e6b61754f req-2816b4f1-864d-4ca3-a3cf-1995cb0a7086 tempest-ServerActionsTestOtherA-1750096549 None] Deleting attachment aeb17307-a6bc-4258-85d4-985b1ac4db11. {{(pid=86980) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:07:55 devstack sudo[93920]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f796a6dc-9d87-4507-a0b5-ab70c6b26afd 1073741824" returned: 0 in 0.874s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f796a6dc-9d87-4507-a0b5-ab70c6b26afd {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:55 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f796a6dc-9d87-4507-a0b5-ab70c6b26afd Sep 28 18:07:55 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:56 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f796a6dc-9d87-4507-a0b5-ab70c6b26afd" returned: 0 in 0.455s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:07:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb69a211-52a3-423e-9690-6348373065c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f796a6dc-9d87-4507-a0b5-ab70c6b26afd', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3582e515-b712-4166-8b84-2be385eae6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:56 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Volume volume-f796a6dc-9d87-4507-a0b5-ab70c6b26afd (f796a6dc-9d87-4507-a0b5-ab70c6b26afd): created successfully Sep 28 18:07:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3582e515-b712-4166-8b84-2be385eae6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Flow 'volume_create_manager' (22eb7fec-2826-4682-a2ef-90f2fd69abe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:07:56 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-0a2cc7a8-605c-480b-9342-bab061740e15 tempest-GroupsTest-881750182 None] Created volume successfully. Sep 28 18:07:57 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:07:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Flow 'volume_create_manager' (03d81c25-b259-4f9b-8354-fae487821940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:07:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bcbcec7-b2a2-43e7-9f49-bf0667ae3aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bcbcec7-b2a2-43e7-9f49-bf0667ae3aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2012237175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=14194096-5504-46e8-9998-331339acb838,host='devstack@QuobyteHD#QuobyteHD',id=20a11dad-5648-4705-90a5-cda1e0949fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edf133b52f9a4ba29bf4835e762e2f39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:58Z,use_quota=True,user_id='d237114b4609425d829eb33707bb643d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(756b3410-f5ed-48a3-bb32-9d6d96951714),volume_type_id=756b3410-f5ed-48a3-bb32-9d6d96951714)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bae69e4-bca0-4adf-a731-d0fc6ff8b9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bae69e4-bca0-4adf-a731-d0fc6ff8b9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eefd5db-529a-48a1-bf4c-c8198238617f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eefd5db-529a-48a1-bf4c-c8198238617f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20a11dad-5648-4705-90a5-cda1e0949fa8', 'volume_name': 'volume-20a11dad-5648-4705-90a5-cda1e0949fa8', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fb285aa-e90b-4175-b2c3-5c3e4ee542f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fb285aa-e90b-4175-b2c3-5c3e4ee542f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3760c92-e2f7-459e-97a0-bc3093c6afee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:58 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Volume 20a11dad-5648-4705-90a5-cda1e0949fa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20a11dad-5648-4705-90a5-cda1e0949fa8', 'volume_size': 1} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=14194096-5504-46e8-9998-331339acb838,created_at=2026-09-28T16:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2012237175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=14194096-5504-46e8-9998-331339acb838,host='devstack@QuobyteHD#QuobyteHD',id=20a11dad-5648-4705-90a5-cda1e0949fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edf133b52f9a4ba29bf4835e762e2f39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:58Z,use_quota=True,user_id='d237114b4609425d829eb33707bb643d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(756b3410-f5ed-48a3-bb32-9d6d96951714),volume_type_id=756b3410-f5ed-48a3-bb32-9d6d96951714)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Creating volume 20a11dad-5648-4705-90a5-cda1e0949fa8 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:07:58 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-20a11dad-5648-4705-90a5-cda1e0949fa8 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:58 devstack sudo[93961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-20a11dad-5648-4705-90a5-cda1e0949fa8 1073741824 Sep 28 18:07:58 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Flow 'volume_create_manager' (d9712747-12b3-4a73-a77e-f0277ad08146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8f0520-d66e-4595-9b50-06c3853bbed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8f0520-d66e-4595-9b50-06c3853bbed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-585870871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0145584a-6ea1-4db7-885f-2cceda73080d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3be6937831ce4b6cb5eec43c52bd41d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:58Z,use_quota=True,user_id='46247bd6c0f848d4be6559d1172d00c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaeb57f4-be57-4350-9d62-a1ad0a28de3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaeb57f4-be57-4350-9d62-a1ad0a28de3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daf9c617-485c-4fb0-b1f2-6ef3b1e887c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daf9c617-485c-4fb0-b1f2-6ef3b1e887c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0145584a-6ea1-4db7-885f-2cceda73080d', 'volume_name': 'volume-0145584a-6ea1-4db7-885f-2cceda73080d', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9afc3017-9585-40dd-bd33-6fd0b58640f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9afc3017-9585-40dd-bd33-6fd0b58640f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52fb56ab-55bd-44c8-a8e7-165802f39010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:58 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Volume 0145584a-6ea1-4db7-885f-2cceda73080d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0145584a-6ea1-4db7-885f-2cceda73080d', 'volume_size': 1} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-0dda7105-0541-475a-9e8b-7e1e6b61754f req-7cebd89b-ec80-4981-9be5-56482ffae8ad tempest-ServerActionsTestOtherA-1750096549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:58 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-20a11dad-5648-4705-90a5-cda1e0949fa8 1073741824" returned: 0 in 0.535s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-20a11dad-5648-4705-90a5-cda1e0949fa8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:58 devstack sudo[93970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-20a11dad-5648-4705-90a5-cda1e0949fa8 Sep 28 18:07:58 devstack sudo[93970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:58 devstack sudo[93970]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-20a11dad-5648-4705-90a5-cda1e0949fa8" returned: 0 in 0.376s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.807s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-585870871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0145584a-6ea1-4db7-885f-2cceda73080d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3be6937831ce4b6cb5eec43c52bd41d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:07:58Z,use_quota=True,user_id='46247bd6c0f848d4be6559d1172d00c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Creating volume 0145584a-6ea1-4db7-885f-2cceda73080d {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:07:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:07:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:07:59 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:07:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0145584a-6ea1-4db7-885f-2cceda73080d 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3760c92-e2f7-459e-97a0-bc3093c6afee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20a11dad-5648-4705-90a5-cda1e0949fa8', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:59 devstack sudo[93976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0145584a-6ea1-4db7-885f-2cceda73080d 1073741824 Sep 28 18:07:59 devstack sudo[93976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512ae210-0314-4094-8298-80a87662aca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:59 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Volume volume-20a11dad-5648-4705-90a5-cda1e0949fa8 (20a11dad-5648-4705-90a5-cda1e0949fa8): created successfully Sep 28 18:07:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512ae210-0314-4094-8298-80a87662aca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Flow 'volume_create_manager' (03d81c25-b259-4f9b-8354-fae487821940) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:07:59 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-8e27ea0d-ee26-40f8-aa20-c07d68e26ec1 tempest-GroupsTest-881750182 None] Created volume successfully. Sep 28 18:07:59 devstack sudo[93976]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0145584a-6ea1-4db7-885f-2cceda73080d 1073741824" returned: 0 in 0.506s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0145584a-6ea1-4db7-885f-2cceda73080d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:07:59 devstack sudo[93982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0145584a-6ea1-4db7-885f-2cceda73080d Sep 28 18:07:59 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:07:59 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root Sep 28 18:07:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0145584a-6ea1-4db7-885f-2cceda73080d" returned: 0 in 0.303s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:07:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:07:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-0dda7105-0541-475a-9e8b-7e1e6b61754f req-7cebd89b-ec80-4981-9be5-56482ffae8ad tempest-ServerActionsTestOtherA-1750096549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.677s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:07:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52fb56ab-55bd-44c8-a8e7-165802f39010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0145584a-6ea1-4db7-885f-2cceda73080d', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da09590-7a39-466b-b0b0-d03d406bf534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:07:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-0dda7105-0541-475a-9e8b-7e1e6b61754f req-7cebd89b-ec80-4981-9be5-56482ffae8ad tempest-ServerActionsTestOtherA-1750096549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:07:59 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Volume volume-0145584a-6ea1-4db7-885f-2cceda73080d (0145584a-6ea1-4db7-885f-2cceda73080d): created successfully Sep 28 18:07:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da09590-7a39-466b-b0b0-d03d406bf534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:07:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Flow 'volume_create_manager' (d9712747-12b3-4a73-a77e-f0277ad08146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:07:59 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-56300247-ac5e-45e5-8b31-cbdc1a5c0b4d tempest-ServersNegativeTestJSON-616355829 None] Created volume successfully. Sep 28 18:08:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-0dda7105-0541-475a-9e8b-7e1e6b61754f req-7cebd89b-ec80-4981-9be5-56482ffae8ad tempest-ServerActionsTestOtherA-1750096549 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729', 'name': 'volume-55ec1b80-13ff-430a-8431-4e46a2ff9441', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6e5b069-48ff-4096-8955-7da7ebdd58ba', 'enforce_multipath': True} {{(pid=86980) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:08:00 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-0dda7105-0541-475a-9e8b-7e1e6b61754f req-7cebd89b-ec80-4981-9be5-56482ffae8ad tempest-ServerActionsTestOtherA-1750096549 None] attachment_update completed successfully. Sep 28 18:08:00 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-64f246ae-e4d1-44c7-9e74-19b648ce03e8 tempest-GroupsTest-881750182 None] Update group completed successfully. Sep 28 18:08:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-aaf76564-05d1-42b1-8f8c-f0783b146d91 tempest-ServersNegativeTestJSON-616355829 None] Acquiring lock "cinder-0145584a-6ea1-4db7-885f-2cceda73080d-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-aaf76564-05d1-42b1-8f8c-f0783b146d91 tempest-ServersNegativeTestJSON-616355829 None] Lock "cinder-0145584a-6ea1-4db7-885f-2cceda73080d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-aaf76564-05d1-42b1-8f8c-f0783b146d91 tempest-ServersNegativeTestJSON-616355829 None] Acquiring lock "cinder-quobyte-0145584a-6ea1-4db7-885f-2cceda73080d" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-aaf76564-05d1-42b1-8f8c-f0783b146d91 tempest-ServersNegativeTestJSON-616355829 None] Lock "cinder-quobyte-0145584a-6ea1-4db7-885f-2cceda73080d" acquired by "delete_volume" :: waited 0.034s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:01 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbba7aa-b30f-4092-9001-d4c863a26ca9]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-aaf76564-05d1-42b1-8f8c-f0783b146d91 tempest-ServersNegativeTestJSON-616355829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0145584a-6ea1-4db7-885f-2cceda73080d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:01 devstack sudo[94102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0145584a-6ea1-4db7-885f-2cceda73080d Sep 28 18:08:01 devstack sudo[94102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:01 devstack sudo[94102]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-aaf76564-05d1-42b1-8f8c-f0783b146d91 tempest-ServersNegativeTestJSON-616355829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0145584a-6ea1-4db7-885f-2cceda73080d" returned: 0 in 0.631s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-aaf76564-05d1-42b1-8f8c-f0783b146d91 tempest-ServersNegativeTestJSON-616355829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0145584a-6ea1-4db7-885f-2cceda73080d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:01 devstack sudo[94431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0145584a-6ea1-4db7-885f-2cceda73080d Sep 28 18:08:01 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:02 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-b359a1ef-f6a8-4991-bfbd-dc73b8aeb5c4 tempest-GroupsTest-881750182 None] Update group completed successfully. Sep 28 18:08:02 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-aaf76564-05d1-42b1-8f8c-f0783b146d91 tempest-ServersNegativeTestJSON-616355829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0145584a-6ea1-4db7-885f-2cceda73080d" returned: 0 in 0.584s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:02 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-aaf76564-05d1-42b1-8f8c-f0783b146d91 tempest-ServersNegativeTestJSON-616355829 None] Lock "cinder-quobyte-0145584a-6ea1-4db7-885f-2cceda73080d" released by "delete_volume" :: held 1.285s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:02 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-aaf76564-05d1-42b1-8f8c-f0783b146d91 tempest-ServersNegativeTestJSON-616355829 None] Created reservations ['99a0fad2-d653-487a-a449-d1dea8023b0e', 'd66e170a-d629-49f3-b91b-824cc2f65f01', '139c4f1d-3257-4e7d-b0a0-bdd373b2a423', 'f29b2d9c-07b1-4eda-a522-47326ddffcf8'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-aaf76564-05d1-42b1-8f8c-f0783b146d91 tempest-ServersNegativeTestJSON-616355829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-aaf76564-05d1-42b1-8f8c-f0783b146d91 tempest-ServersNegativeTestJSON-616355829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-aaf76564-05d1-42b1-8f8c-f0783b146d91 tempest-ServersNegativeTestJSON-616355829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-aaf76564-05d1-42b1-8f8c-f0783b146d91 tempest-ServersNegativeTestJSON-616355829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-aaf76564-05d1-42b1-8f8c-f0783b146d91 tempest-ServersNegativeTestJSON-616355829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-aaf76564-05d1-42b1-8f8c-f0783b146d91 tempest-ServersNegativeTestJSON-616355829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:02 devstack sudo[94443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:08:02 devstack sudo[94443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:02 devstack sudo[94443]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-aaf76564-05d1-42b1-8f8c-f0783b146d91 tempest-ServersNegativeTestJSON-616355829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.275s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:02 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-aaf76564-05d1-42b1-8f8c-f0783b146d91 tempest-ServersNegativeTestJSON-616355829 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:02 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-aaf76564-05d1-42b1-8f8c-f0783b146d91 tempest-ServersNegativeTestJSON-616355829 None] Deleted volume successfully. Sep 28 18:08:02 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-aaf76564-05d1-42b1-8f8c-f0783b146d91 tempest-ServersNegativeTestJSON-616355829 None] Lock "cinder-0145584a-6ea1-4db7-885f-2cceda73080d-delete_volume" released by "delete_volume" :: held 1.928s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:03 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-dfaac09b-4dd5-44b8-b570-a6150d89a336 tempest-ServersNegativeTestJSON-616355829 None] Acquiring lock "cinder-36f056b5-7285-4ba4-8be2-a383c824e12b-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:03 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-dfaac09b-4dd5-44b8-b570-a6150d89a336 tempest-ServersNegativeTestJSON-616355829 None] Lock "cinder-36f056b5-7285-4ba4-8be2-a383c824e12b-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:03 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-dfaac09b-4dd5-44b8-b570-a6150d89a336 tempest-ServersNegativeTestJSON-616355829 None] Acquiring lock "cinder-quobyte-36f056b5-7285-4ba4-8be2-a383c824e12b" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:03 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-dfaac09b-4dd5-44b8-b570-a6150d89a336 tempest-ServersNegativeTestJSON-616355829 None] Lock "cinder-quobyte-36f056b5-7285-4ba4-8be2-a383c824e12b" acquired by "delete_volume" :: waited 0.027s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:03 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[803136e7-9dbf-45f3-a131-32b892cd7f0a]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-dfaac09b-4dd5-44b8-b570-a6150d89a336 tempest-ServersNegativeTestJSON-616355829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-36f056b5-7285-4ba4-8be2-a383c824e12b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:03 devstack sudo[94465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-36f056b5-7285-4ba4-8be2-a383c824e12b Sep 28 18:08:03 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c7675054-ef38-4dd5-adef-82d4a92fc4d9 tempest-GroupsTest-881750182 None] Acquiring lock "cinder-quobyte-20a11dad-5648-4705-90a5-cda1e0949fa8" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c7675054-ef38-4dd5-adef-82d4a92fc4d9 tempest-GroupsTest-881750182 None] Lock "cinder-quobyte-20a11dad-5648-4705-90a5-cda1e0949fa8" acquired by "delete_volume" :: waited 0.025s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:04 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f627331-3088-422a-a608-c7da0378bcb8]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c7675054-ef38-4dd5-adef-82d4a92fc4d9 tempest-GroupsTest-881750182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-20a11dad-5648-4705-90a5-cda1e0949fa8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:04 devstack sudo[94467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-20a11dad-5648-4705-90a5-cda1e0949fa8 Sep 28 18:08:04 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:04 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-dfaac09b-4dd5-44b8-b570-a6150d89a336 tempest-ServersNegativeTestJSON-616355829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-36f056b5-7285-4ba4-8be2-a383c824e12b" returned: 0 in 0.647s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-dfaac09b-4dd5-44b8-b570-a6150d89a336 tempest-ServersNegativeTestJSON-616355829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-36f056b5-7285-4ba4-8be2-a383c824e12b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:04 devstack sudo[94472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-36f056b5-7285-4ba4-8be2-a383c824e12b Sep 28 18:08:04 devstack sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:08:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:04 devstack sudo[94474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:08:04 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:04 devstack sudo[94472]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-dfaac09b-4dd5-44b8-b570-a6150d89a336 tempest-ServersNegativeTestJSON-616355829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-36f056b5-7285-4ba4-8be2-a383c824e12b" returned: 0 in 0.382s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-dfaac09b-4dd5-44b8-b570-a6150d89a336 tempest-ServersNegativeTestJSON-616355829 None] Lock "cinder-quobyte-36f056b5-7285-4ba4-8be2-a383c824e12b" released by "delete_volume" :: held 1.106s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:04 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c7675054-ef38-4dd5-adef-82d4a92fc4d9 tempest-GroupsTest-881750182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-20a11dad-5648-4705-90a5-cda1e0949fa8" returned: 0 in 0.725s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c7675054-ef38-4dd5-adef-82d4a92fc4d9 tempest-GroupsTest-881750182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-20a11dad-5648-4705-90a5-cda1e0949fa8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:04 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-20a11dad-5648-4705-90a5-cda1e0949fa8 Sep 28 18:08:04 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:05 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-dfaac09b-4dd5-44b8-b570-a6150d89a336 tempest-ServersNegativeTestJSON-616355829 None] Created reservations ['f9627ef8-204b-4c03-a4c6-2a6c2b06744f', 'a20f7d88-0459-41cf-83dc-12fb3e8a4e35', '7ad3e43f-440e-4fc1-90f0-606a1798c4f1', 'f227c687-e8e5-4e41-8ded-47140f01c07f'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-dfaac09b-4dd5-44b8-b570-a6150d89a336 tempest-ServersNegativeTestJSON-616355829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-dfaac09b-4dd5-44b8-b570-a6150d89a336 tempest-ServersNegativeTestJSON-616355829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-dfaac09b-4dd5-44b8-b570-a6150d89a336 tempest-ServersNegativeTestJSON-616355829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-dfaac09b-4dd5-44b8-b570-a6150d89a336 tempest-ServersNegativeTestJSON-616355829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-dfaac09b-4dd5-44b8-b570-a6150d89a336 tempest-ServersNegativeTestJSON-616355829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-dfaac09b-4dd5-44b8-b570-a6150d89a336 tempest-ServersNegativeTestJSON-616355829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:05 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:05 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:08:05 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.798s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:05 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:05 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager._thread_info {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:08:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread count: 28 {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:08:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread info: [<_MainThread(MainThread, started 129097393381504)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:08:05 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c7675054-ef38-4dd5-adef-82d4a92fc4d9 tempest-GroupsTest-881750182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-20a11dad-5648-4705-90a5-cda1e0949fa8" returned: 0 in 0.708s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c7675054-ef38-4dd5-adef-82d4a92fc4d9 tempest-GroupsTest-881750182 None] Lock "cinder-quobyte-20a11dad-5648-4705-90a5-cda1e0949fa8" released by "delete_volume" :: held 1.527s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c7675054-ef38-4dd5-adef-82d4a92fc4d9 tempest-GroupsTest-881750182 None] Acquiring lock "cinder-quobyte-f796a6dc-9d87-4507-a0b5-ab70c6b26afd" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c7675054-ef38-4dd5-adef-82d4a92fc4d9 tempest-GroupsTest-881750182 None] Lock "cinder-quobyte-f796a6dc-9d87-4507-a0b5-ab70c6b26afd" acquired by "delete_volume" :: waited 0.018s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:05 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[334e68d9-d603-4b3b-a8e2-c8787c6f03e1]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c7675054-ef38-4dd5-adef-82d4a92fc4d9 tempest-GroupsTest-881750182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f796a6dc-9d87-4507-a0b5-ab70c6b26afd {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:05 devstack sudo[94488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f796a6dc-9d87-4507-a0b5-ab70c6b26afd Sep 28 18:08:05 devstack sudo[94488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:05 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-dfaac09b-4dd5-44b8-b570-a6150d89a336 tempest-ServersNegativeTestJSON-616355829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.589s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:05 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-dfaac09b-4dd5-44b8-b570-a6150d89a336 tempest-ServersNegativeTestJSON-616355829 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:05 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-dfaac09b-4dd5-44b8-b570-a6150d89a336 tempest-ServersNegativeTestJSON-616355829 None] Deleted volume successfully. Sep 28 18:08:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-dfaac09b-4dd5-44b8-b570-a6150d89a336 tempest-ServersNegativeTestJSON-616355829 None] Lock "cinder-36f056b5-7285-4ba4-8be2-a383c824e12b-delete_volume" released by "delete_volume" :: held 2.324s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:06 devstack sudo[94488]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c7675054-ef38-4dd5-adef-82d4a92fc4d9 tempest-GroupsTest-881750182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f796a6dc-9d87-4507-a0b5-ab70c6b26afd" returned: 0 in 0.597s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c7675054-ef38-4dd5-adef-82d4a92fc4d9 tempest-GroupsTest-881750182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f796a6dc-9d87-4507-a0b5-ab70c6b26afd {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:06 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f796a6dc-9d87-4507-a0b5-ab70c6b26afd Sep 28 18:08:06 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:06 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c7675054-ef38-4dd5-adef-82d4a92fc4d9 tempest-GroupsTest-881750182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f796a6dc-9d87-4507-a0b5-ab70c6b26afd" returned: 0 in 0.376s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c7675054-ef38-4dd5-adef-82d4a92fc4d9 tempest-GroupsTest-881750182 None] Lock "cinder-quobyte-f796a6dc-9d87-4507-a0b5-ab70c6b26afd" released by "delete_volume" :: held 1.041s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:06 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-c7675054-ef38-4dd5-adef-82d4a92fc4d9 tempest-GroupsTest-881750182 None] Created reservations ['2c03e91e-ea1e-4d09-ba30-a41790dd0f90'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:06 devstack cinder-volume[86980]: WARNING cinder.quota [None req-c7675054-ef38-4dd5-adef-82d4a92fc4d9 tempest-GroupsTest-881750182 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-114126440 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-114126440, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:08:06 devstack cinder-volume[86980]: WARNING cinder.quota [None req-c7675054-ef38-4dd5-adef-82d4a92fc4d9 tempest-GroupsTest-881750182 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-114126440 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-114126440, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:08:07 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-c7675054-ef38-4dd5-adef-82d4a92fc4d9 tempest-GroupsTest-881750182 None] Created reservations ['e2005057-c1ac-4ce8-9bcb-1f4e243f17c4', '005354b4-b254-44bd-b8f8-4a02dfa5cfd8', 'ea40dd41-9440-4f85-b94b-e09e79e35ddd', '5a430596-315a-4166-999f-670f79fbc556'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:07 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-c7675054-ef38-4dd5-adef-82d4a92fc4d9 tempest-GroupsTest-881750182 None] Created reservations ['9eba1fc6-a046-4dc2-8f7b-5377bc6929cb', 'b78642c8-5618-49a3-9d9c-36ffcbb62837', 'a0a69989-d5ab-4f89-8270-9f53e5eaa905', 'd54f6c2c-2144-4c88-8e1c-37eaa47b31ad'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c7675054-ef38-4dd5-adef-82d4a92fc4d9 tempest-GroupsTest-881750182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c7675054-ef38-4dd5-adef-82d4a92fc4d9 tempest-GroupsTest-881750182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c7675054-ef38-4dd5-adef-82d4a92fc4d9 tempest-GroupsTest-881750182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c7675054-ef38-4dd5-adef-82d4a92fc4d9 tempest-GroupsTest-881750182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c7675054-ef38-4dd5-adef-82d4a92fc4d9 tempest-GroupsTest-881750182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c7675054-ef38-4dd5-adef-82d4a92fc4d9 tempest-GroupsTest-881750182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:07 devstack sudo[94516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:08:07 devstack sudo[94516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:08 devstack sudo[94516]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c7675054-ef38-4dd5-adef-82d4a92fc4d9 tempest-GroupsTest-881750182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.793s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:08 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-c7675054-ef38-4dd5-adef-82d4a92fc4d9 tempest-GroupsTest-881750182 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:08 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-c7675054-ef38-4dd5-adef-82d4a92fc4d9 tempest-GroupsTest-881750182 None] Delete group completed successfully. Sep 28 18:08:21 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=78,cinder:UPDATE=83,cinder:DELETE=5,cinder:INSERT=19 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:08:21 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=62,cinder:UPDATE=78,cinder:INSERT=14,cinder:DELETE=4 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:08:23 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:08:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Flow 'volume_create_manager' (afe00b0f-a284-4d88-9c59-d0e5ca3a3728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8378463d-31de-42f0-87eb-977a492537a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8378463d-31de-42f0-87eb-977a492537a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-832508363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06728888-f7a8-4efb-bce9-0dd4c7e57c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eef8034aabfc427a9ac470cc565873c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:23Z,use_quota=True,user_id='e8c7c01923a84cd7a3d5536da65f5d99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53db5df9-a046-46f8-84c7-d99d200cfa5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53db5df9-a046-46f8-84c7-d99d200cfa5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824ae02e-6ae9-4ff7-beb8-daa86e59d6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824ae02e-6ae9-4ff7-beb8-daa86e59d6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06728888-f7a8-4efb-bce9-0dd4c7e57c6a', 'volume_name': 'volume-06728888-f7a8-4efb-bce9-0dd4c7e57c6a', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2075dbaf-03d7-4ddd-8857-6f61e5b448f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2075dbaf-03d7-4ddd-8857-6f61e5b448f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c3f827-6001-4137-9571-0f2f3f84563b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:23 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Volume 06728888-f7a8-4efb-bce9-0dd4c7e57c6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06728888-f7a8-4efb-bce9-0dd4c7e57c6a', 'volume_size': 1} Sep 28 18:08:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-832508363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06728888-f7a8-4efb-bce9-0dd4c7e57c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eef8034aabfc427a9ac470cc565873c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:23Z,use_quota=True,user_id='e8c7c01923a84cd7a3d5536da65f5d99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:08:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Creating volume 06728888-f7a8-4efb-bce9-0dd4c7e57c6a {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:08:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:08:23 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:08:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-06728888-f7a8-4efb-bce9-0dd4c7e57c6a 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:23 devstack sudo[94572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-06728888-f7a8-4efb-bce9-0dd4c7e57c6a 1073741824 Sep 28 18:08:23 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:24 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-06728888-f7a8-4efb-bce9-0dd4c7e57c6a 1073741824" returned: 0 in 0.619s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-06728888-f7a8-4efb-bce9-0dd4c7e57c6a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:24 devstack sudo[94578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-06728888-f7a8-4efb-bce9-0dd4c7e57c6a Sep 28 18:08:24 devstack sudo[94578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:24 devstack sudo[94578]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-06728888-f7a8-4efb-bce9-0dd4c7e57c6a" returned: 0 in 0.345s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:24 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:08:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c3f827-6001-4137-9571-0f2f3f84563b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06728888-f7a8-4efb-bce9-0dd4c7e57c6a', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cad8338b-add2-42e9-aa52-faa391a64b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:24 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Volume volume-06728888-f7a8-4efb-bce9-0dd4c7e57c6a (06728888-f7a8-4efb-bce9-0dd4c7e57c6a): created successfully Sep 28 18:08:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cad8338b-add2-42e9-aa52-faa391a64b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Flow 'volume_create_manager' (afe00b0f-a284-4d88-9c59-d0e5ca3a3728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:24 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-47e8f279-2c59-4961-a274-c1f673ed76a4 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Created volume successfully. Sep 28 18:08:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-edd200f1-d036-4a48-9dfd-f8cc2dcebd8b tempest-BackendsCapabilitiesAdminTestsJSON-912394574 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1236991882324, 'free_capacity_gb': 1775.1236991882324, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86980) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 18:08:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-516f58a0-99f0-497b-b28e-03134c04fb24 tempest-BackendsCapabilitiesAdminTestsJSON-912394574 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1236991882324, 'free_capacity_gb': 1775.1236991882324, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86980) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 18:08:26 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-93dbbc11-8fdb-4454-b0d5-a5dbc70453d9 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Acquiring lock "cinder-06728888-f7a8-4efb-bce9-0dd4c7e57c6a-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:26 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-93dbbc11-8fdb-4454-b0d5-a5dbc70453d9 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Lock "cinder-06728888-f7a8-4efb-bce9-0dd4c7e57c6a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:26 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-93dbbc11-8fdb-4454-b0d5-a5dbc70453d9 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Acquiring lock "cinder-quobyte-06728888-f7a8-4efb-bce9-0dd4c7e57c6a" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:26 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-93dbbc11-8fdb-4454-b0d5-a5dbc70453d9 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Lock "cinder-quobyte-06728888-f7a8-4efb-bce9-0dd4c7e57c6a" acquired by "delete_volume" :: waited 0.027s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:26 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3427f81d-2860-49b7-a9e2-b755bac5b1f9]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-93dbbc11-8fdb-4454-b0d5-a5dbc70453d9 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-06728888-f7a8-4efb-bce9-0dd4c7e57c6a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:26 devstack sudo[94581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-06728888-f7a8-4efb-bce9-0dd4c7e57c6a Sep 28 18:08:26 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:27 devstack sudo[94581]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-93dbbc11-8fdb-4454-b0d5-a5dbc70453d9 tempest-VolumeQuotasNegativeTestJSON-83746973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-06728888-f7a8-4efb-bce9-0dd4c7e57c6a" returned: 0 in 0.487s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-93dbbc11-8fdb-4454-b0d5-a5dbc70453d9 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-06728888-f7a8-4efb-bce9-0dd4c7e57c6a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:27 devstack sudo[94587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-06728888-f7a8-4efb-bce9-0dd4c7e57c6a Sep 28 18:08:27 devstack sudo[94587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:27 devstack sudo[94587]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-93dbbc11-8fdb-4454-b0d5-a5dbc70453d9 tempest-VolumeQuotasNegativeTestJSON-83746973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-06728888-f7a8-4efb-bce9-0dd4c7e57c6a" returned: 0 in 0.292s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:27 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-93dbbc11-8fdb-4454-b0d5-a5dbc70453d9 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Lock "cinder-quobyte-06728888-f7a8-4efb-bce9-0dd4c7e57c6a" released by "delete_volume" :: held 0.845s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:27 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-93dbbc11-8fdb-4454-b0d5-a5dbc70453d9 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Created reservations ['8b7ef0dd-9d64-4a15-96db-35e05715b551', '868cd6b0-e75d-4350-85a1-817a3cb31685', '2f382d7e-9e9e-4cb5-b628-7aba3965d4f9', '904d4839-102b-4459-98ae-1cd682e69be2'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-93dbbc11-8fdb-4454-b0d5-a5dbc70453d9 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-93dbbc11-8fdb-4454-b0d5-a5dbc70453d9 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-93dbbc11-8fdb-4454-b0d5-a5dbc70453d9 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-93dbbc11-8fdb-4454-b0d5-a5dbc70453d9 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-93dbbc11-8fdb-4454-b0d5-a5dbc70453d9 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-93dbbc11-8fdb-4454-b0d5-a5dbc70453d9 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:27 devstack sudo[94590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:08:27 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:28 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-93dbbc11-8fdb-4454-b0d5-a5dbc70453d9 tempest-VolumeQuotasNegativeTestJSON-83746973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.361s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:28 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-93dbbc11-8fdb-4454-b0d5-a5dbc70453d9 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:28 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-93dbbc11-8fdb-4454-b0d5-a5dbc70453d9 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Deleted volume successfully. Sep 28 18:08:28 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-93dbbc11-8fdb-4454-b0d5-a5dbc70453d9 tempest-VolumeQuotasNegativeTestJSON-83746973 None] Lock "cinder-06728888-f7a8-4efb-bce9-0dd4c7e57c6a-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:31 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:08:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Flow 'volume_create_manager' (50402b83-34f6-4bc5-928b-1dc77e44e530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3271d67-06b1-46c0-9587-9f0f4a38c615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3271d67-06b1-46c0-9587-9f0f4a38c615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1225516641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b2c484b-7bba-4b1c-8b45-87644221db99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dba6d7f17a074c038a7b54d889895212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:32Z,use_quota=True,user_id='45ab052cd50940fa80a8f366e0e34320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da5264f5-80c2-4b9d-9a28-2aea858bd6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da5264f5-80c2-4b9d-9a28-2aea858bd6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c34c90e-d466-4e79-835d-c4670fd5c3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c34c90e-d466-4e79-835d-c4670fd5c3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b2c484b-7bba-4b1c-8b45-87644221db99', 'volume_name': 'volume-2b2c484b-7bba-4b1c-8b45-87644221db99', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67536522-3310-4dca-bf6f-80aa45c055c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67536522-3310-4dca-bf6f-80aa45c055c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d9a8ce-da04-4966-b988-744d42fb97e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:31 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Volume 2b2c484b-7bba-4b1c-8b45-87644221db99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b2c484b-7bba-4b1c-8b45-87644221db99', 'volume_size': 1} Sep 28 18:08:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:31 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1225516641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b2c484b-7bba-4b1c-8b45-87644221db99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dba6d7f17a074c038a7b54d889895212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:32Z,use_quota=True,user_id='45ab052cd50940fa80a8f366e0e34320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:08:31 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Creating volume 2b2c484b-7bba-4b1c-8b45-87644221db99 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:08:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:31 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:31 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:31 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:08:31 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:08:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:31 devstack sudo[94594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99 1073741824 Sep 28 18:08:31 devstack sudo[94594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:32 devstack sudo[94594]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99 1073741824" returned: 0 in 0.911s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:32 devstack sudo[94600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99 Sep 28 18:08:32 devstack sudo[94600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:33 devstack sudo[94600]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99" returned: 0 in 0.297s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:08:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d9a8ce-da04-4966-b988-744d42fb97e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b2c484b-7bba-4b1c-8b45-87644221db99', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (570b7afe-172c-42fc-9a12-dc72d78cd99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:33 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Volume volume-2b2c484b-7bba-4b1c-8b45-87644221db99 (2b2c484b-7bba-4b1c-8b45-87644221db99): created successfully Sep 28 18:08:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (570b7afe-172c-42fc-9a12-dc72d78cd99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Flow 'volume_create_manager' (50402b83-34f6-4bc5-928b-1dc77e44e530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:33 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-92b55631-a1b2-4341-b548-cf0f8a7589d4 tempest-SnapshotMetadataTestJSON-1096827949 None] Created volume successfully. Sep 28 18:08:34 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-810834c6-24e6-4bcb-beca-301677d010d4 tempest-GroupSnapshotsTest-2048302865 None] Group tempest-GroupSnapshotsTest-Group-594839688: creating Sep 28 18:08:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8bbdf636-4234-4560-96b9-8a6e2df23ded tempest-SnapshotMetadataTestJSON-1096827949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8bbdf636-4234-4560-96b9-8a6e2df23ded tempest-SnapshotMetadataTestJSON-1096827949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:34 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-8bbdf636-4234-4560-96b9-8a6e2df23ded tempest-SnapshotMetadataTestJSON-1096827949 None] Creating offline snapshot e9130f2d-0a86-4fb0-b26e-505dda9c087d of volume 2b2c484b-7bba-4b1c-8b45-87644221db99 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:08:34 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-810834c6-24e6-4bcb-beca-301677d010d4 tempest-GroupSnapshotsTest-2048302865 None] Group tempest-GroupSnapshotsTest-Group-594839688: created successfully Sep 28 18:08:34 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0ac127-3550-4b2c-9d1e-2466a3370ec4]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8bbdf636-4234-4560-96b9-8a6e2df23ded tempest-SnapshotMetadataTestJSON-1096827949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:34 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-810834c6-24e6-4bcb-beca-301677d010d4 tempest-GroupSnapshotsTest-2048302865 None] Create group completed successfully. Sep 28 18:08:34 devstack sudo[94620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99 Sep 28 18:08:34 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:34 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8bbdf636-4234-4560-96b9-8a6e2df23ded tempest-SnapshotMetadataTestJSON-1096827949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99" returned: 0 in 0.487s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8bbdf636-4234-4560-96b9-8a6e2df23ded tempest-SnapshotMetadataTestJSON-1096827949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99.e9130f2d-0a86-4fb0-b26e-505dda9c087d 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:34 devstack sudo[94625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99.e9130f2d-0a86-4fb0-b26e-505dda9c087d 1G Sep 28 18:08:34 devstack sudo[94625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:35 devstack sudo[94625]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8bbdf636-4234-4560-96b9-8a6e2df23ded tempest-SnapshotMetadataTestJSON-1096827949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99.e9130f2d-0a86-4fb0-b26e-505dda9c087d 1G" returned: 0 in 0.574s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8bbdf636-4234-4560-96b9-8a6e2df23ded tempest-SnapshotMetadataTestJSON-1096827949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b2c484b-7bba-4b1c-8b45-87644221db99 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99.e9130f2d-0a86-4fb0-b26e-505dda9c087d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:35 devstack sudo[94633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b2c484b-7bba-4b1c-8b45-87644221db99 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99.e9130f2d-0a86-4fb0-b26e-505dda9c087d Sep 28 18:08:35 devstack sudo[94633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:35 devstack sudo[94633]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8bbdf636-4234-4560-96b9-8a6e2df23ded tempest-SnapshotMetadataTestJSON-1096827949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b2c484b-7bba-4b1c-8b45-87644221db99 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99.e9130f2d-0a86-4fb0-b26e-505dda9c087d" returned: 0 in 0.472s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:35 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-8bbdf636-4234-4560-96b9-8a6e2df23ded tempest-SnapshotMetadataTestJSON-1096827949 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99.e9130f2d-0a86-4fb0-b26e-505dda9c087d is being set with open permissions: ugo+rw Sep 28 18:08:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8bbdf636-4234-4560-96b9-8a6e2df23ded tempest-SnapshotMetadataTestJSON-1096827949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99.e9130f2d-0a86-4fb0-b26e-505dda9c087d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:35 devstack sudo[94639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99.e9130f2d-0a86-4fb0-b26e-505dda9c087d Sep 28 18:08:35 devstack sudo[94639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:36 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:08:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Flow 'volume_create_manager' (2207480c-1db7-4cb5-a62f-56e2ad1f1a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (867517eb-d54b-4dba-b4ce-2e84da080b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (867517eb-d54b-4dba-b4ce-2e84da080b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1244694001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a4cc159f-8767-431e-bef6-c5ae8d357a08,host='devstack@QuobyteHD#QuobyteHD',id=6c2efdec-f2f1-424f-8396-f769562ad017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed6ea6a95a694eb7aebf67c31e8a6284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:36Z,use_quota=True,user_id='a1c5f38590a043f6809feec582507926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87f5cbc7-dc38-4a90-bbbf-21f557c76a5f),volume_type_id=87f5cbc7-dc38-4a90-bbbf-21f557c76a5f)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70adfb4c-a561-42cb-b8c0-8c4993a36eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70adfb4c-a561-42cb-b8c0-8c4993a36eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e694b788-f656-42d0-90d3-262009df09b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e694b788-f656-42d0-90d3-262009df09b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c2efdec-f2f1-424f-8396-f769562ad017', 'volume_name': 'volume-6c2efdec-f2f1-424f-8396-f769562ad017', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60462f94-6ed9-4126-ad27-dbeb51a857c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60462f94-6ed9-4126-ad27-dbeb51a857c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9505a42a-c017-4c30-9d5c-fa7524a7c746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:36 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Volume 6c2efdec-f2f1-424f-8396-f769562ad017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c2efdec-f2f1-424f-8396-f769562ad017', 'volume_size': 1} Sep 28 18:08:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:36 devstack sudo[94639]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8bbdf636-4234-4560-96b9-8a6e2df23ded tempest-SnapshotMetadataTestJSON-1096827949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99.e9130f2d-0a86-4fb0-b26e-505dda9c087d" returned: 0 in 0.401s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8bbdf636-4234-4560-96b9-8a6e2df23ded tempest-SnapshotMetadataTestJSON-1096827949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:36 devstack sudo[94647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99.info Sep 28 18:08:36 devstack sudo[94647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:36 devstack sudo[94647]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8bbdf636-4234-4560-96b9-8a6e2df23ded tempest-SnapshotMetadataTestJSON-1096827949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99.info" returned: 0 in 0.552s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:36 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-8bbdf636-4234-4560-96b9-8a6e2df23ded tempest-SnapshotMetadataTestJSON-1096827949 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99.info is being set with open permissions: ugo+rw Sep 28 18:08:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8bbdf636-4234-4560-96b9-8a6e2df23ded tempest-SnapshotMetadataTestJSON-1096827949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:36 devstack sudo[94669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99.info Sep 28 18:08:36 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:37 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8bbdf636-4234-4560-96b9-8a6e2df23ded tempest-SnapshotMetadataTestJSON-1096827949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99.info" returned: 0 in 0.364s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8bbdf636-4234-4560-96b9-8a6e2df23ded tempest-SnapshotMetadataTestJSON-1096827949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.057s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.049s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a4cc159f-8767-431e-bef6-c5ae8d357a08,created_at=2026-09-28T16:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1244694001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a4cc159f-8767-431e-bef6-c5ae8d357a08,host='devstack@QuobyteHD#QuobyteHD',id=6c2efdec-f2f1-424f-8396-f769562ad017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed6ea6a95a694eb7aebf67c31e8a6284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:36Z,use_quota=True,user_id='a1c5f38590a043f6809feec582507926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87f5cbc7-dc38-4a90-bbbf-21f557c76a5f),volume_type_id=87f5cbc7-dc38-4a90-bbbf-21f557c76a5f)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:08:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Creating volume 6c2efdec-f2f1-424f-8396-f769562ad017 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:08:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:08:37 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:08:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:37 devstack sudo[94676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017 1073741824 Sep 28 18:08:37 devstack sudo[94676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:37 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-8bbdf636-4234-4560-96b9-8a6e2df23ded tempest-SnapshotMetadataTestJSON-1096827949 None] Create snapshot completed successfully Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Flow 'volume_create_manager' (3b1e08e2-e627-4254-ad11-c05a7938fbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f0c949-a146-47b2-9ab5-35e0e35b40f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f0c949-a146-47b2-9ab5-35e0e35b40f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-121284492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6142f4f6-5ebd-4590-8c51-271b37fec405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f12aa07d3c114c7f9fad0ce0a0843783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:38Z,use_quota=True,user_id='b1641c52be974677a7a354d2c679d25a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07410b00-6c04-4142-8bef-fbd7d80f810f),volume_type_id=07410b00-6c04-4142-8bef-fbd7d80f810f)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f5a5ba-51ef-45e6-868b-a3c76926fcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f5a5ba-51ef-45e6-868b-a3c76926fcb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06137254-b2d8-4bf5-bc9b-c35a2ddb6354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06137254-b2d8-4bf5-bc9b-c35a2ddb6354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6142f4f6-5ebd-4590-8c51-271b37fec405', 'volume_name': 'volume-6142f4f6-5ebd-4590-8c51-271b37fec405', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (083378f8-e237-4985-bb82-1f804351a38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (083378f8-e237-4985-bb82-1f804351a38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9650e4-eb28-4720-a8fd-55d1dd659dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:38 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Volume 6142f4f6-5ebd-4590-8c51-271b37fec405: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6142f4f6-5ebd-4590-8c51-271b37fec405', 'volume_size': 1} Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:38 devstack sudo[94676]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017 1073741824" returned: 0 in 0.870s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:38 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017 Sep 28 18:08:38 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:38 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017" returned: 0 in 0.355s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.442s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-121284492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6142f4f6-5ebd-4590-8c51-271b37fec405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f12aa07d3c114c7f9fad0ce0a0843783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:08:38Z,use_quota=True,user_id='b1641c52be974677a7a354d2c679d25a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07410b00-6c04-4142-8bef-fbd7d80f810f),volume_type_id=07410b00-6c04-4142-8bef-fbd7d80f810f)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Creating volume 6142f4f6-5ebd-4590-8c51-271b37fec405 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:08:38 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6142f4f6-5ebd-4590-8c51-271b37fec405 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9505a42a-c017-4c30-9d5c-fa7524a7c746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c2efdec-f2f1-424f-8396-f769562ad017', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faf09e9e-ae1e-49ab-888c-5be2bc50799d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:38 devstack sudo[94687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6142f4f6-5ebd-4590-8c51-271b37fec405 1073741824 Sep 28 18:08:38 devstack sudo[94687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:38 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Volume volume-6c2efdec-f2f1-424f-8396-f769562ad017 (6c2efdec-f2f1-424f-8396-f769562ad017): created successfully Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faf09e9e-ae1e-49ab-888c-5be2bc50799d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Flow 'volume_create_manager' (2207480c-1db7-4cb5-a62f-56e2ad1f1a86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:38 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-059bb22f-3349-4703-a322-e1452c688d0f tempest-GroupSnapshotsTest-2048302865 None] Created volume successfully. Sep 28 18:08:38 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-619c3f53-0b11-4b7b-9979-cc4e86f7e6b9 tempest-SnapshotMetadataTestJSON-1096827949 None] Acquiring lock "cinder-e9130f2d-0a86-4fb0-b26e-505dda9c087d-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-619c3f53-0b11-4b7b-9979-cc4e86f7e6b9 tempest-SnapshotMetadataTestJSON-1096827949 None] Lock "cinder-e9130f2d-0a86-4fb0-b26e-505dda9c087d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-619c3f53-0b11-4b7b-9979-cc4e86f7e6b9 tempest-SnapshotMetadataTestJSON-1096827949 None] Acquiring lock "cinder-quobyte-2b2c484b-7bba-4b1c-8b45-87644221db99" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-619c3f53-0b11-4b7b-9979-cc4e86f7e6b9 tempest-SnapshotMetadataTestJSON-1096827949 None] Lock "cinder-quobyte-2b2c484b-7bba-4b1c-8b45-87644221db99" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-619c3f53-0b11-4b7b-9979-cc4e86f7e6b9 tempest-SnapshotMetadataTestJSON-1096827949 None] Acquiring lock "cinder-quobyte-e9130f2d-0a86-4fb0-b26e-505dda9c087d" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-619c3f53-0b11-4b7b-9979-cc4e86f7e6b9 tempest-SnapshotMetadataTestJSON-1096827949 None] Lock "cinder-quobyte-e9130f2d-0a86-4fb0-b26e-505dda9c087d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-619c3f53-0b11-4b7b-9979-cc4e86f7e6b9 tempest-SnapshotMetadataTestJSON-1096827949 None] Deleting offline snapshot e9130f2d-0a86-4fb0-b26e-505dda9c087d of volume 2b2c484b-7bba-4b1c-8b45-87644221db99 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:08:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-619c3f53-0b11-4b7b-9979-cc4e86f7e6b9 tempest-SnapshotMetadataTestJSON-1096827949 None] snapshot_file for this snap is: volume-2b2c484b-7bba-4b1c-8b45-87644221db99.e9130f2d-0a86-4fb0-b26e-505dda9c087d {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:08:39 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c1fcc3-0cbf-4b5d-ac05-1553b28184c8]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619c3f53-0b11-4b7b-9979-cc4e86f7e6b9 tempest-SnapshotMetadataTestJSON-1096827949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99.e9130f2d-0a86-4fb0-b26e-505dda9c087d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:39 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-235be7a2-7d7c-4db3-82a4-fbdcc7248d1f req-d57470ea-32bf-40e7-8fc2-97425125ae41 tempest-ServerActionsTestOtherA-1750096549 None] Terminate volume connection completed successfully. Sep 28 18:08:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-235be7a2-7d7c-4db3-82a4-fbdcc7248d1f req-d57470ea-32bf-40e7-8fc2-97425125ae41 tempest-ServerActionsTestOtherA-1750096549 None] Deleting attachment d6e5b069-48ff-4096-8955-7da7ebdd58ba. {{(pid=86980) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:08:39 devstack sudo[94693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99.e9130f2d-0a86-4fb0-b26e-505dda9c087d Sep 28 18:08:39 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:39 devstack sudo[94687]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6142f4f6-5ebd-4590-8c51-271b37fec405 1073741824" returned: 0 in 0.741s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-235be7a2-7d7c-4db3-82a4-fbdcc7248d1f req-be50fc51-7f2c-4635-9b3f-cd5c86e422d2 tempest-ServerActionsTestOtherA-1750096549 None] Acquiring lock "cinder-55ec1b80-13ff-430a-8431-4e46a2ff9441-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6142f4f6-5ebd-4590-8c51-271b37fec405 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-235be7a2-7d7c-4db3-82a4-fbdcc7248d1f req-be50fc51-7f2c-4635-9b3f-cd5c86e422d2 tempest-ServerActionsTestOtherA-1750096549 None] Lock "cinder-55ec1b80-13ff-430a-8431-4e46a2ff9441-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:39 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6142f4f6-5ebd-4590-8c51-271b37fec405 Sep 28 18:08:39 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-235be7a2-7d7c-4db3-82a4-fbdcc7248d1f req-be50fc51-7f2c-4635-9b3f-cd5c86e422d2 tempest-ServerActionsTestOtherA-1750096549 None] Acquiring lock "cinder-quobyte-55ec1b80-13ff-430a-8431-4e46a2ff9441" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-235be7a2-7d7c-4db3-82a4-fbdcc7248d1f req-be50fc51-7f2c-4635-9b3f-cd5c86e422d2 tempest-ServerActionsTestOtherA-1750096549 None] Lock "cinder-quobyte-55ec1b80-13ff-430a-8431-4e46a2ff9441" acquired by "delete_volume" :: waited 0.020s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:39 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0095a26-9372-4883-84e9-442355f2c646]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-235be7a2-7d7c-4db3-82a4-fbdcc7248d1f req-be50fc51-7f2c-4635-9b3f-cd5c86e422d2 tempest-ServerActionsTestOtherA-1750096549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55ec1b80-13ff-430a-8431-4e46a2ff9441 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:39 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619c3f53-0b11-4b7b-9979-cc4e86f7e6b9 tempest-SnapshotMetadataTestJSON-1096827949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99.e9130f2d-0a86-4fb0-b26e-505dda9c087d" returned: 0 in 0.485s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-619c3f53-0b11-4b7b-9979-cc4e86f7e6b9 tempest-SnapshotMetadataTestJSON-1096827949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b2c484b-7bba-4b1c-8b45-87644221db99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:08:39 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5582e256-e087-4d6d-8829-22fc046c0be1]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619c3f53-0b11-4b7b-9979-cc4e86f7e6b9 tempest-SnapshotMetadataTestJSON-1096827949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:39 devstack sudo[94700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55ec1b80-13ff-430a-8431-4e46a2ff9441 Sep 28 18:08:39 devstack sudo[94700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:39 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6142f4f6-5ebd-4590-8c51-271b37fec405" returned: 0 in 0.379s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:08:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9650e4-eb28-4720-a8fd-55d1dd659dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6142f4f6-5ebd-4590-8c51-271b37fec405', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c6eaaba-0e8f-4425-b43f-3da8bb11aa02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:08:39 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Volume volume-6142f4f6-5ebd-4590-8c51-271b37fec405 (6142f4f6-5ebd-4590-8c51-271b37fec405): created successfully Sep 28 18:08:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c6eaaba-0e8f-4425-b43f-3da8bb11aa02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:08:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Flow 'volume_create_manager' (3b1e08e2-e627-4254-ad11-c05a7938fbf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:08:39 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-193b504d-4d51-41e2-a7b0-1dd89310b739 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Created volume successfully. Sep 28 18:08:39 devstack sudo[94703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99 Sep 28 18:08:39 devstack sudo[94703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:40 devstack sudo[94700]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-235be7a2-7d7c-4db3-82a4-fbdcc7248d1f req-be50fc51-7f2c-4635-9b3f-cd5c86e422d2 tempest-ServerActionsTestOtherA-1750096549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55ec1b80-13ff-430a-8431-4e46a2ff9441" returned: 0 in 0.661s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-235be7a2-7d7c-4db3-82a4-fbdcc7248d1f req-be50fc51-7f2c-4635-9b3f-cd5c86e422d2 tempest-ServerActionsTestOtherA-1750096549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55ec1b80-13ff-430a-8431-4e46a2ff9441 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:40 devstack sudo[94711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55ec1b80-13ff-430a-8431-4e46a2ff9441 Sep 28 18:08:40 devstack sudo[94711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:40 devstack sudo[94703]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619c3f53-0b11-4b7b-9979-cc4e86f7e6b9 tempest-SnapshotMetadataTestJSON-1096827949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99" returned: 0 in 0.709s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619c3f53-0b11-4b7b-9979-cc4e86f7e6b9 tempest-SnapshotMetadataTestJSON-1096827949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99.e9130f2d-0a86-4fb0-b26e-505dda9c087d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:40 devstack sudo[94714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99.e9130f2d-0a86-4fb0-b26e-505dda9c087d Sep 28 18:08:40 devstack sudo[94714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:40 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-77b339e6-be3b-4596-b68c-918923e25af0 tempest-GroupSnapshotsTest-2048302865 None] GroupSnapshot f354230c-c566-41bb-860b-3f187ae90d32: creating. Sep 28 18:08:40 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-77b339e6-be3b-4596-b68c-918923e25af0 tempest-GroupSnapshotsTest-2048302865 None] Group snapshot f354230c-c566-41bb-860b-3f187ae90d32: creating. {{(pid=86980) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 18:08:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-77b339e6-be3b-4596-b68c-918923e25af0 tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-77b339e6-be3b-4596-b68c-918923e25af0 tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:40 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-77b339e6-be3b-4596-b68c-918923e25af0 tempest-GroupSnapshotsTest-2048302865 None] Creating offline snapshot 8a857219-03d8-4b0c-b4dc-f758531befdf of volume 6c2efdec-f2f1-424f-8396-f769562ad017 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:08:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ba29340d-b0c5-4e69-aa2e-11ac942e655c tempest-ServerActionsTestOtherA-1750096549 None] Acquiring lock "cinder-aa608ea7-6718-459b-b622-ed2567fe7654-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:40 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e467cfa-4338-461d-b760-a93dc2bb5ef0]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-77b339e6-be3b-4596-b68c-918923e25af0 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ba29340d-b0c5-4e69-aa2e-11ac942e655c tempest-ServerActionsTestOtherA-1750096549 None] Lock "cinder-aa608ea7-6718-459b-b622-ed2567fe7654-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:40 devstack sudo[94711]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-235be7a2-7d7c-4db3-82a4-fbdcc7248d1f req-be50fc51-7f2c-4635-9b3f-cd5c86e422d2 tempest-ServerActionsTestOtherA-1750096549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55ec1b80-13ff-430a-8431-4e46a2ff9441" returned: 0 in 0.511s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-235be7a2-7d7c-4db3-82a4-fbdcc7248d1f req-be50fc51-7f2c-4635-9b3f-cd5c86e422d2 tempest-ServerActionsTestOtherA-1750096549 None] Lock "cinder-quobyte-55ec1b80-13ff-430a-8431-4e46a2ff9441" released by "delete_volume" :: held 1.246s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ba29340d-b0c5-4e69-aa2e-11ac942e655c tempest-ServerActionsTestOtherA-1750096549 None] Acquiring lock "cinder-quobyte-aa608ea7-6718-459b-b622-ed2567fe7654" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ba29340d-b0c5-4e69-aa2e-11ac942e655c tempest-ServerActionsTestOtherA-1750096549 None] Lock "cinder-quobyte-aa608ea7-6718-459b-b622-ed2567fe7654" acquired by "delete_volume" :: waited 0.039s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:40 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[510c875b-ab8a-402a-aea6-61b6ae4a8fdb]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ba29340d-b0c5-4e69-aa2e-11ac942e655c tempest-ServerActionsTestOtherA-1750096549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-aa608ea7-6718-459b-b622-ed2567fe7654 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:40 devstack cinder-volume[86980]: DEBUG cinder.quota [req-235be7a2-7d7c-4db3-82a4-fbdcc7248d1f req-be50fc51-7f2c-4635-9b3f-cd5c86e422d2 tempest-ServerActionsTestOtherA-1750096549 None] Created reservations ['664bce16-9122-48e6-a122-0ca6ae8be1ea', '70a55752-fbba-447a-8883-548c8b69182d', '6232ea96-8dda-4d98-993f-b95a029bdf63', 'b7e05375-1e0f-43db-b250-5bdcdcd5ea37'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:40 devstack sudo[94718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017 Sep 28 18:08:40 devstack sudo[94718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:40 devstack sudo[94714]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619c3f53-0b11-4b7b-9979-cc4e86f7e6b9 tempest-SnapshotMetadataTestJSON-1096827949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99.e9130f2d-0a86-4fb0-b26e-505dda9c087d" returned: 0 in 0.556s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619c3f53-0b11-4b7b-9979-cc4e86f7e6b9 tempest-SnapshotMetadataTestJSON-1096827949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99.e9130f2d-0a86-4fb0-b26e-505dda9c087d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:41 devstack sudo[94725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99.e9130f2d-0a86-4fb0-b26e-505dda9c087d Sep 28 18:08:41 devstack sudo[94725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:41 devstack sudo[94723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-aa608ea7-6718-459b-b622-ed2567fe7654 Sep 28 18:08:41 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-235be7a2-7d7c-4db3-82a4-fbdcc7248d1f req-be50fc51-7f2c-4635-9b3f-cd5c86e422d2 tempest-ServerActionsTestOtherA-1750096549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-235be7a2-7d7c-4db3-82a4-fbdcc7248d1f req-be50fc51-7f2c-4635-9b3f-cd5c86e422d2 tempest-ServerActionsTestOtherA-1750096549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [req-235be7a2-7d7c-4db3-82a4-fbdcc7248d1f req-be50fc51-7f2c-4635-9b3f-cd5c86e422d2 tempest-ServerActionsTestOtherA-1750096549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [req-235be7a2-7d7c-4db3-82a4-fbdcc7248d1f req-be50fc51-7f2c-4635-9b3f-cd5c86e422d2 tempest-ServerActionsTestOtherA-1750096549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-235be7a2-7d7c-4db3-82a4-fbdcc7248d1f req-be50fc51-7f2c-4635-9b3f-cd5c86e422d2 tempest-ServerActionsTestOtherA-1750096549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-235be7a2-7d7c-4db3-82a4-fbdcc7248d1f req-be50fc51-7f2c-4635-9b3f-cd5c86e422d2 tempest-ServerActionsTestOtherA-1750096549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:41 devstack sudo[94728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:08:41 devstack sudo[94728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d35a2ed4-ae6f-4537-8f05-180260ef52a7 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d35a2ed4-ae6f-4537-8f05-180260ef52a7 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d35a2ed4-ae6f-4537-8f05-180260ef52a7 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d35a2ed4-ae6f-4537-8f05-180260ef52a7 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d35a2ed4-ae6f-4537-8f05-180260ef52a7 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d35a2ed4-ae6f-4537-8f05-180260ef52a7 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:41 devstack sudo[94730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:08:41 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:41 devstack sudo[94725]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619c3f53-0b11-4b7b-9979-cc4e86f7e6b9 tempest-SnapshotMetadataTestJSON-1096827949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99.e9130f2d-0a86-4fb0-b26e-505dda9c087d" returned: 0 in 0.395s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:41 devstack sudo[94718]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-77b339e6-be3b-4596-b68c-918923e25af0 tempest-GroupSnapshotsTest-2048302865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017" returned: 0 in 0.745s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-77b339e6-be3b-4596-b68c-918923e25af0 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017.8a857219-03d8-4b0c-b4dc-f758531befdf 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:41 devstack sudo[94739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017.8a857219-03d8-4b0c-b4dc-f758531befdf 1G Sep 28 18:08:41 devstack sudo[94739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:41 devstack sudo[94728]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-235be7a2-7d7c-4db3-82a4-fbdcc7248d1f req-be50fc51-7f2c-4635-9b3f-cd5c86e422d2 tempest-ServerActionsTestOtherA-1750096549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.380s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG cinder.manager [req-235be7a2-7d7c-4db3-82a4-fbdcc7248d1f req-be50fc51-7f2c-4635-9b3f-cd5c86e422d2 tempest-ServerActionsTestOtherA-1750096549 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-619c3f53-0b11-4b7b-9979-cc4e86f7e6b9 tempest-SnapshotMetadataTestJSON-1096827949 None] Lock "cinder-quobyte-e9130f2d-0a86-4fb0-b26e-505dda9c087d" released by "_delete_snapshot" :: held 2.342s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:41 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-235be7a2-7d7c-4db3-82a4-fbdcc7248d1f req-be50fc51-7f2c-4635-9b3f-cd5c86e422d2 tempest-ServerActionsTestOtherA-1750096549 None] Deleted volume successfully. Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-619c3f53-0b11-4b7b-9979-cc4e86f7e6b9 tempest-SnapshotMetadataTestJSON-1096827949 None] Lock "cinder-quobyte-2b2c484b-7bba-4b1c-8b45-87644221db99" released by "delete_snapshot" :: held 2.383s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:41 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ba29340d-b0c5-4e69-aa2e-11ac942e655c tempest-ServerActionsTestOtherA-1750096549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-aa608ea7-6718-459b-b622-ed2567fe7654" returned: 0 in 0.648s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ba29340d-b0c5-4e69-aa2e-11ac942e655c tempest-ServerActionsTestOtherA-1750096549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-aa608ea7-6718-459b-b622-ed2567fe7654 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-235be7a2-7d7c-4db3-82a4-fbdcc7248d1f req-be50fc51-7f2c-4635-9b3f-cd5c86e422d2 tempest-ServerActionsTestOtherA-1750096549 None] Lock "cinder-55ec1b80-13ff-430a-8431-4e46a2ff9441-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:41 devstack sudo[94743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-aa608ea7-6718-459b-b622-ed2567fe7654 Sep 28 18:08:41 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:41 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d35a2ed4-ae6f-4537-8f05-180260ef52a7 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.374s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-d35a2ed4-ae6f-4537-8f05-180260ef52a7 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:41 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-d35a2ed4-ae6f-4537-8f05-180260ef52a7 tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Retype volume completed successfully. Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-619c3f53-0b11-4b7b-9979-cc4e86f7e6b9 tempest-SnapshotMetadataTestJSON-1096827949 None] Created reservations ['35ab8b49-be51-46f7-8fbe-58a5be332097', '6ab49ca4-9f9a-48de-bcb9-9c3e9f4f70cd', 'f7c383ad-e19e-4f88-b673-beeba4e95a38', '9ed7120b-9e30-482a-a9c8-66f36dc332e9'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:41 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-619c3f53-0b11-4b7b-9979-cc4e86f7e6b9 tempest-SnapshotMetadataTestJSON-1096827949 None] Delete snapshot completed successfully. Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-619c3f53-0b11-4b7b-9979-cc4e86f7e6b9 tempest-SnapshotMetadataTestJSON-1096827949 None] Lock "cinder-e9130f2d-0a86-4fb0-b26e-505dda9c087d-delete_snapshot" released by "delete_snapshot" :: held 2.624s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:41 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ba29340d-b0c5-4e69-aa2e-11ac942e655c tempest-ServerActionsTestOtherA-1750096549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-aa608ea7-6718-459b-b622-ed2567fe7654" returned: 0 in 0.310s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ba29340d-b0c5-4e69-aa2e-11ac942e655c tempest-ServerActionsTestOtherA-1750096549 None] Lock "cinder-quobyte-aa608ea7-6718-459b-b622-ed2567fe7654" released by "delete_volume" :: held 1.011s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:41 devstack sudo[94739]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-77b339e6-be3b-4596-b68c-918923e25af0 tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017.8a857219-03d8-4b0c-b4dc-f758531befdf 1G" returned: 0 in 0.506s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-77b339e6-be3b-4596-b68c-918923e25af0 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c2efdec-f2f1-424f-8396-f769562ad017 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017.8a857219-03d8-4b0c-b4dc-f758531befdf {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-ba29340d-b0c5-4e69-aa2e-11ac942e655c tempest-ServerActionsTestOtherA-1750096549 None] Created reservations ['35e41379-a227-41fa-a049-f8b75cf073d2', '32e6cd2c-ff35-4c25-a247-6451abec111b', 'ea296b61-a15e-4d7b-bc58-76c343f730cd', 'ac5713a1-7904-4e6e-9df3-bbf7cbc87d72'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:41 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c2efdec-f2f1-424f-8396-f769562ad017 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017.8a857219-03d8-4b0c-b4dc-f758531befdf Sep 28 18:08:41 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ba29340d-b0c5-4e69-aa2e-11ac942e655c tempest-ServerActionsTestOtherA-1750096549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ba29340d-b0c5-4e69-aa2e-11ac942e655c tempest-ServerActionsTestOtherA-1750096549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ba29340d-b0c5-4e69-aa2e-11ac942e655c tempest-ServerActionsTestOtherA-1750096549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ba29340d-b0c5-4e69-aa2e-11ac942e655c tempest-ServerActionsTestOtherA-1750096549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ba29340d-b0c5-4e69-aa2e-11ac942e655c tempest-ServerActionsTestOtherA-1750096549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ba29340d-b0c5-4e69-aa2e-11ac942e655c tempest-ServerActionsTestOtherA-1750096549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:42 devstack sudo[94752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:08:42 devstack sudo[94752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:42 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-77b339e6-be3b-4596-b68c-918923e25af0 tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c2efdec-f2f1-424f-8396-f769562ad017 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017.8a857219-03d8-4b0c-b4dc-f758531befdf" returned: 0 in 0.334s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:42 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-77b339e6-be3b-4596-b68c-918923e25af0 tempest-GroupSnapshotsTest-2048302865 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017.8a857219-03d8-4b0c-b4dc-f758531befdf is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:08:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-77b339e6-be3b-4596-b68c-918923e25af0 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017.8a857219-03d8-4b0c-b4dc-f758531befdf {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:42 devstack sudo[94758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017.8a857219-03d8-4b0c-b4dc-f758531befdf Sep 28 18:08:42 devstack sudo[94758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:42 devstack sudo[94752]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ba29340d-b0c5-4e69-aa2e-11ac942e655c tempest-ServerActionsTestOtherA-1750096549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.310s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:42 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-ba29340d-b0c5-4e69-aa2e-11ac942e655c tempest-ServerActionsTestOtherA-1750096549 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:42 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-ba29340d-b0c5-4e69-aa2e-11ac942e655c tempest-ServerActionsTestOtherA-1750096549 None] Deleted volume successfully. Sep 28 18:08:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ba29340d-b0c5-4e69-aa2e-11ac942e655c tempest-ServerActionsTestOtherA-1750096549 None] Lock "cinder-aa608ea7-6718-459b-b622-ed2567fe7654-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b825a97d-802b-40c7-8d5d-e98bfb5edb2d tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Acquiring lock "cinder-6142f4f6-5ebd-4590-8c51-271b37fec405-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b825a97d-802b-40c7-8d5d-e98bfb5edb2d tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Lock "cinder-6142f4f6-5ebd-4590-8c51-271b37fec405-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4e80554c-30ee-4b68-a151-c9acbc294201 tempest-SnapshotMetadataTestJSON-1096827949 None] Acquiring lock "cinder-2b2c484b-7bba-4b1c-8b45-87644221db99-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4e80554c-30ee-4b68-a151-c9acbc294201 tempest-SnapshotMetadataTestJSON-1096827949 None] Lock "cinder-2b2c484b-7bba-4b1c-8b45-87644221db99-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b825a97d-802b-40c7-8d5d-e98bfb5edb2d tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Acquiring lock "cinder-quobyte-6142f4f6-5ebd-4590-8c51-271b37fec405" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b825a97d-802b-40c7-8d5d-e98bfb5edb2d tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Lock "cinder-quobyte-6142f4f6-5ebd-4590-8c51-271b37fec405" acquired by "delete_volume" :: waited 0.025s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:42 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22a799e-840d-4203-8fcb-33cd0b7b0863]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b825a97d-802b-40c7-8d5d-e98bfb5edb2d tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6142f4f6-5ebd-4590-8c51-271b37fec405 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4e80554c-30ee-4b68-a151-c9acbc294201 tempest-SnapshotMetadataTestJSON-1096827949 None] Acquiring lock "cinder-quobyte-2b2c484b-7bba-4b1c-8b45-87644221db99" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:42 devstack sudo[94758]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-77b339e6-be3b-4596-b68c-918923e25af0 tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017.8a857219-03d8-4b0c-b4dc-f758531befdf" returned: 0 in 0.348s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4e80554c-30ee-4b68-a151-c9acbc294201 tempest-SnapshotMetadataTestJSON-1096827949 None] Lock "cinder-quobyte-2b2c484b-7bba-4b1c-8b45-87644221db99" acquired by "delete_volume" :: waited 0.028s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-77b339e6-be3b-4596-b68c-918923e25af0 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:42 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e25d4b6-273b-4ed8-87d2-08dab28e1e9c]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4e80554c-30ee-4b68-a151-c9acbc294201 tempest-SnapshotMetadataTestJSON-1096827949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:42 devstack sudo[94763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017.info Sep 28 18:08:42 devstack sudo[94762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6142f4f6-5ebd-4590-8c51-271b37fec405 Sep 28 18:08:42 devstack sudo[94762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:42 devstack sudo[94763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:42 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99 Sep 28 18:08:42 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:42 devstack sudo[94763]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-77b339e6-be3b-4596-b68c-918923e25af0 tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017.info" returned: 0 in 0.301s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:42 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-77b339e6-be3b-4596-b68c-918923e25af0 tempest-GroupSnapshotsTest-2048302865 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:08:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-77b339e6-be3b-4596-b68c-918923e25af0 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:42 devstack sudo[94762]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b825a97d-802b-40c7-8d5d-e98bfb5edb2d tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6142f4f6-5ebd-4590-8c51-271b37fec405" returned: 0 in 0.434s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b825a97d-802b-40c7-8d5d-e98bfb5edb2d tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6142f4f6-5ebd-4590-8c51-271b37fec405 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:42 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017.info Sep 28 18:08:42 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:43 devstack sudo[94774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6142f4f6-5ebd-4590-8c51-271b37fec405 Sep 28 18:08:43 devstack sudo[94774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:43 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4e80554c-30ee-4b68-a151-c9acbc294201 tempest-SnapshotMetadataTestJSON-1096827949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99" returned: 0 in 0.449s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4e80554c-30ee-4b68-a151-c9acbc294201 tempest-SnapshotMetadataTestJSON-1096827949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:43 devstack sudo[94780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99 Sep 28 18:08:43 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:43 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-77b339e6-be3b-4596-b68c-918923e25af0 tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017.info" returned: 0 in 0.365s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-77b339e6-be3b-4596-b68c-918923e25af0 tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.808s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:43 devstack sudo[94774]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b825a97d-802b-40c7-8d5d-e98bfb5edb2d tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6142f4f6-5ebd-4590-8c51-271b37fec405" returned: 0 in 0.398s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b825a97d-802b-40c7-8d5d-e98bfb5edb2d tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Lock "cinder-quobyte-6142f4f6-5ebd-4590-8c51-271b37fec405" released by "delete_volume" :: held 0.898s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:43 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4e80554c-30ee-4b68-a151-c9acbc294201 tempest-SnapshotMetadataTestJSON-1096827949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2b2c484b-7bba-4b1c-8b45-87644221db99" returned: 0 in 0.368s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:43 devstack cinder-volume[86980]: WARNING cinder.quota [None req-b825a97d-802b-40c7-8d5d-e98bfb5edb2d tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:08:43 devstack cinder-volume[86980]: WARNING cinder.quota [None req-b825a97d-802b-40c7-8d5d-e98bfb5edb2d tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:08:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4e80554c-30ee-4b68-a151-c9acbc294201 tempest-SnapshotMetadataTestJSON-1096827949 None] Lock "cinder-quobyte-2b2c484b-7bba-4b1c-8b45-87644221db99" released by "delete_volume" :: held 0.934s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:43 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-77b339e6-be3b-4596-b68c-918923e25af0 tempest-GroupSnapshotsTest-2048302865 None] group_snapshot f354230c-c566-41bb-860b-3f187ae90d32: created successfully Sep 28 18:08:43 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-b825a97d-802b-40c7-8d5d-e98bfb5edb2d tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Created reservations ['2ac2800d-cfda-4ec1-b714-b0c18713adc8', '51abf57a-f752-4501-abba-86523cf39fbf', '7cedf2f3-c8ad-4de9-984e-6a3a5f44f3dd', 'cb4c5253-d21e-42c6-98e1-f62b8291fd17'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:43 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-4e80554c-30ee-4b68-a151-c9acbc294201 tempest-SnapshotMetadataTestJSON-1096827949 None] Created reservations ['d50b0ee1-e7f2-4751-b0a1-bad76f7c4617', '4020d606-4336-4f48-aaf6-345149e8a9f2', '4199a49b-f602-4706-a773-af816952a4a5', 'f7d40466-ae76-4bd4-bcf1-5cff0e8b8125'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b825a97d-802b-40c7-8d5d-e98bfb5edb2d tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b825a97d-802b-40c7-8d5d-e98bfb5edb2d tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b825a97d-802b-40c7-8d5d-e98bfb5edb2d tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b825a97d-802b-40c7-8d5d-e98bfb5edb2d tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b825a97d-802b-40c7-8d5d-e98bfb5edb2d tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b825a97d-802b-40c7-8d5d-e98bfb5edb2d tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:43 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:08:43 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4e80554c-30ee-4b68-a151-c9acbc294201 tempest-SnapshotMetadataTestJSON-1096827949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4e80554c-30ee-4b68-a151-c9acbc294201 tempest-SnapshotMetadataTestJSON-1096827949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4e80554c-30ee-4b68-a151-c9acbc294201 tempest-SnapshotMetadataTestJSON-1096827949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4e80554c-30ee-4b68-a151-c9acbc294201 tempest-SnapshotMetadataTestJSON-1096827949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4e80554c-30ee-4b68-a151-c9acbc294201 tempest-SnapshotMetadataTestJSON-1096827949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4e80554c-30ee-4b68-a151-c9acbc294201 tempest-SnapshotMetadataTestJSON-1096827949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:43 devstack sudo[94807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:08:43 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:44 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b825a97d-802b-40c7-8d5d-e98bfb5edb2d tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.519s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:44 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-b825a97d-802b-40c7-8d5d-e98bfb5edb2d tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:44 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-b825a97d-802b-40c7-8d5d-e98bfb5edb2d tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Deleted volume successfully. Sep 28 18:08:44 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b825a97d-802b-40c7-8d5d-e98bfb5edb2d tempest-VolumeRetypeWithoutMigrationTest-1454070380 None] Lock "cinder-6142f4f6-5ebd-4590-8c51-271b37fec405-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:44 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4e80554c-30ee-4b68-a151-c9acbc294201 tempest-SnapshotMetadataTestJSON-1096827949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.404s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:44 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-4e80554c-30ee-4b68-a151-c9acbc294201 tempest-SnapshotMetadataTestJSON-1096827949 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:08:44 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-4e80554c-30ee-4b68-a151-c9acbc294201 tempest-SnapshotMetadataTestJSON-1096827949 None] Deleted volume successfully. Sep 28 18:08:44 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4e80554c-30ee-4b68-a151-c9acbc294201 tempest-SnapshotMetadataTestJSON-1096827949 None] Lock "cinder-2b2c484b-7bba-4b1c-8b45-87644221db99-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:45 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "cinder-quobyte-8a857219-03d8-4b0c-b4dc-f758531befdf-111c8958-af9d-4bf0-a28d-a13e05017d25" by "_create_volume_from_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:45 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-8a857219-03d8-4b0c-b4dc-f758531befdf-111c8958-af9d-4bf0-a28d-a13e05017d25" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:45 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Creating volume 111c8958-af9d-4bf0-a28d-a13e05017d25 from snapshot 8a857219-03d8-4b0c-b4dc-f758531befdf {{(pid=86980) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:08:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:45 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:45 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:45 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:08:45 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "cinder-quobyte-111c8958-af9d-4bf0-a28d-a13e05017d25" by "_copy_volume_from_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:45 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-111c8958-af9d-4bf0-a28d-a13e05017d25" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:45 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] snapshot: 8a857219-03d8-4b0c-b4dc-f758531befdf, volume: 111c8958-af9d-4bf0-a28d-a13e05017d25, {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:08:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:45 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:45 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:45 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd24fa8-0a67-4ef1-b8ae-2f167a363da7]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017.8a857219-03d8-4b0c-b4dc-f758531befdf {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:45 devstack sudo[94820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017.8a857219-03d8-4b0c-b4dc-f758531befdf Sep 28 18:08:45 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:46 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017.8a857219-03d8-4b0c-b4dc-f758531befdf" returned: 0 in 0.566s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:46 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c2efdec-f2f1-424f-8396-f769562ad017(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:08:46 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[220428b4-ad78-4dc7-ae82-e2243b04f299]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:46 devstack sudo[94825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017 Sep 28 18:08:46 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:46 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017" returned: 0 in 0.547s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:46 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017 {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:08:46 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Creating direct copy from snapshot {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:08:46 devstack cinder-volume[86980]: DEBUG cinder.utils [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Path /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-111c8958-af9d-4bf0-a28d-a13e05017d25 not found in is_blk_device check {{(pid=86980) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:08:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-111c8958-af9d-4bf0-a28d-a13e05017d25 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:46 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-111c8958-af9d-4bf0-a28d-a13e05017d25 Sep 28 18:08:46 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:55 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:UPDATE=70,cinder:SELECT=60,cinder:DELETE=7,cinder:INSERT=11 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:08:55 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=60,cinder:UPDATE=63,cinder:INSERT=19,cinder:DELETE=3 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:08:56 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-111c8958-af9d-4bf0-a28d-a13e05017d25" returned: 0 in 9.774s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:56 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Image conversion details: src /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017, size 1024.00 MB, duration 9.78 sec, destination /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-111c8958-af9d-4bf0-a28d-a13e05017d25 {{(pid=86980) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:08:56 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Converted 1024.00 MB image at 104.75 MB/s Sep 28 18:08:56 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-111c8958-af9d-4bf0-a28d-a13e05017d25 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:08:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-111c8958-af9d-4bf0-a28d-a13e05017d25 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:56 devstack sudo[94894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-111c8958-af9d-4bf0-a28d-a13e05017d25 Sep 28 18:08:56 devstack sudo[94894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:56 devstack sudo[94894]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-111c8958-af9d-4bf0-a28d-a13e05017d25" returned: 0 in 0.346s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:56 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-111c8958-af9d-4bf0-a28d-a13e05017d25" released by "_copy_volume_from_snapshot" :: held 11.368s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:56 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-8a857219-03d8-4b0c-b4dc-f758531befdf-111c8958-af9d-4bf0-a28d-a13e05017d25" released by "_create_volume_from_snapshot" :: held 11.473s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.497s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:57 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-a1e10d76-8ed7-42a4-a381-7bb341f988e4 tempest-GroupSnapshotsTest-2048302865 None] Create group from source-snapshot-f354230c-c566-41bb-860b-3f187ae90d32 completed successfully. Sep 28 18:08:58 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-24c68941-c70b-4089-b04a-c051f148b5df tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "cinder-quobyte-111c8958-af9d-4bf0-a28d-a13e05017d25" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:08:58 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-24c68941-c70b-4089-b04a-c051f148b5df tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-111c8958-af9d-4bf0-a28d-a13e05017d25" acquired by "delete_volume" :: waited 0.025s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:08:58 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cf27bf-2d4e-458a-a20e-e18451cc9ab6]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:08:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-24c68941-c70b-4089-b04a-c051f148b5df tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-111c8958-af9d-4bf0-a28d-a13e05017d25 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:58 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-111c8958-af9d-4bf0-a28d-a13e05017d25 Sep 28 18:08:58 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:59 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-24c68941-c70b-4089-b04a-c051f148b5df tempest-GroupSnapshotsTest-2048302865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-111c8958-af9d-4bf0-a28d-a13e05017d25" returned: 0 in 0.536s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-24c68941-c70b-4089-b04a-c051f148b5df tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-111c8958-af9d-4bf0-a28d-a13e05017d25 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:59 devstack sudo[94908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-111c8958-af9d-4bf0-a28d-a13e05017d25 Sep 28 18:08:59 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:08:59 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root Sep 28 18:08:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-24c68941-c70b-4089-b04a-c051f148b5df tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-111c8958-af9d-4bf0-a28d-a13e05017d25" returned: 0 in 0.346s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:08:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-24c68941-c70b-4089-b04a-c051f148b5df tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-111c8958-af9d-4bf0-a28d-a13e05017d25" released by "delete_volume" :: held 0.963s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:08:59 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-24c68941-c70b-4089-b04a-c051f148b5df tempest-GroupSnapshotsTest-2048302865 None] Created reservations ['38e1f021-c2b7-4d1e-8b86-908e137ee930'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:59 devstack cinder-volume[86980]: WARNING cinder.quota [None req-24c68941-c70b-4089-b04a-c051f148b5df tempest-GroupSnapshotsTest-2048302865 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1197199524 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1197199524, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:08:59 devstack cinder-volume[86980]: WARNING cinder.quota [None req-24c68941-c70b-4089-b04a-c051f148b5df tempest-GroupSnapshotsTest-2048302865 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1197199524 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1197199524, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:08:59 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-24c68941-c70b-4089-b04a-c051f148b5df tempest-GroupSnapshotsTest-2048302865 None] Created reservations ['0792a5d8-3102-4bca-89b9-f361937c199a', 'e8c80dc0-a838-4f55-82ad-bd0c34f4e51d', '5658b495-d08a-43d1-bd1e-c50d4c655feb', '1a16fe11-767e-4fa7-b553-1714afe058a1'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:08:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-24c68941-c70b-4089-b04a-c051f148b5df tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:08:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-24c68941-c70b-4089-b04a-c051f148b5df tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:08:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-24c68941-c70b-4089-b04a-c051f148b5df tempest-GroupSnapshotsTest-2048302865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:08:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-24c68941-c70b-4089-b04a-c051f148b5df tempest-GroupSnapshotsTest-2048302865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:08:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-24c68941-c70b-4089-b04a-c051f148b5df tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:08:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-24c68941-c70b-4089-b04a-c051f148b5df tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:08:59 devstack sudo[94911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:08:59 devstack sudo[94911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:00 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-cb661a48-e95f-4381-8263-1fee8508c5f3 tempest-GroupSnapshotsTest-2048302865 None] group_snapshot f354230c-c566-41bb-860b-3f187ae90d32: deleting Sep 28 18:09:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb661a48-e95f-4381-8263-1fee8508c5f3 tempest-GroupSnapshotsTest-2048302865 None] group_snapshot f354230c-c566-41bb-860b-3f187ae90d32: deleting {{(pid=86980) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 18:09:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cb661a48-e95f-4381-8263-1fee8508c5f3 tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "cinder-quobyte-6c2efdec-f2f1-424f-8396-f769562ad017" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cb661a48-e95f-4381-8263-1fee8508c5f3 tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-6c2efdec-f2f1-424f-8396-f769562ad017" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cb661a48-e95f-4381-8263-1fee8508c5f3 tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "cinder-quobyte-8a857219-03d8-4b0c-b4dc-f758531befdf" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cb661a48-e95f-4381-8263-1fee8508c5f3 tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-8a857219-03d8-4b0c-b4dc-f758531befdf" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-cb661a48-e95f-4381-8263-1fee8508c5f3 tempest-GroupSnapshotsTest-2048302865 None] Deleting offline snapshot 8a857219-03d8-4b0c-b4dc-f758531befdf of volume 6c2efdec-f2f1-424f-8396-f769562ad017 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:09:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-cb661a48-e95f-4381-8263-1fee8508c5f3 tempest-GroupSnapshotsTest-2048302865 None] snapshot_file for this snap is: volume-6c2efdec-f2f1-424f-8396-f769562ad017.8a857219-03d8-4b0c-b4dc-f758531befdf {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:09:00 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8194192d-acbc-496d-9d5c-845e990a370c]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cb661a48-e95f-4381-8263-1fee8508c5f3 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017.8a857219-03d8-4b0c-b4dc-f758531befdf {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:00 devstack sudo[94911]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-24c68941-c70b-4089-b04a-c051f148b5df tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.591s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:00 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-24c68941-c70b-4089-b04a-c051f148b5df tempest-GroupSnapshotsTest-2048302865 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:00 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-24c68941-c70b-4089-b04a-c051f148b5df tempest-GroupSnapshotsTest-2048302865 None] Delete group completed successfully. Sep 28 18:09:00 devstack sudo[94915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017.8a857219-03d8-4b0c-b4dc-f758531befdf Sep 28 18:09:00 devstack sudo[94915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:00 devstack sudo[94915]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cb661a48-e95f-4381-8263-1fee8508c5f3 tempest-GroupSnapshotsTest-2048302865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017.8a857219-03d8-4b0c-b4dc-f758531befdf" returned: 0 in 0.497s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-cb661a48-e95f-4381-8263-1fee8508c5f3 tempest-GroupSnapshotsTest-2048302865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c2efdec-f2f1-424f-8396-f769562ad017(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:09:00 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdae795a-3e35-4620-9882-4236a2ef3e94]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cb661a48-e95f-4381-8263-1fee8508c5f3 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:01 devstack sudo[94920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017 Sep 28 18:09:01 devstack sudo[94920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:01 devstack sudo[94920]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cb661a48-e95f-4381-8263-1fee8508c5f3 tempest-GroupSnapshotsTest-2048302865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017" returned: 0 in 0.737s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cb661a48-e95f-4381-8263-1fee8508c5f3 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017.8a857219-03d8-4b0c-b4dc-f758531befdf {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:01 devstack sudo[94925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017.8a857219-03d8-4b0c-b4dc-f758531befdf Sep 28 18:09:01 devstack sudo[94925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:02 devstack sudo[94925]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cb661a48-e95f-4381-8263-1fee8508c5f3 tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017.8a857219-03d8-4b0c-b4dc-f758531befdf" returned: 0 in 0.485s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cb661a48-e95f-4381-8263-1fee8508c5f3 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017.8a857219-03d8-4b0c-b4dc-f758531befdf {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:02 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017.8a857219-03d8-4b0c-b4dc-f758531befdf Sep 28 18:09:02 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:02 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cb661a48-e95f-4381-8263-1fee8508c5f3 tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017.8a857219-03d8-4b0c-b4dc-f758531befdf" returned: 0 in 0.327s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:02 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cb661a48-e95f-4381-8263-1fee8508c5f3 tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-8a857219-03d8-4b0c-b4dc-f758531befdf" released by "_delete_snapshot" :: held 2.236s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:02 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cb661a48-e95f-4381-8263-1fee8508c5f3 tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-6c2efdec-f2f1-424f-8396-f769562ad017" released by "delete_snapshot" :: held 2.305s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:02 devstack cinder-volume[86980]: WARNING cinder.quota [None req-cb661a48-e95f-4381-8263-1fee8508c5f3 tempest-GroupSnapshotsTest-2048302865 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1197199524 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1197199524, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:09:02 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-cb661a48-e95f-4381-8263-1fee8508c5f3 tempest-GroupSnapshotsTest-2048302865 None] Created reservations ['cfeedefc-ea3b-422a-a447-62832806a9d0', 'e32b3bc5-86fd-4c97-be46-8784bbdf00bc', 'a4577ca9-3778-4815-871e-03ab71448008', '8a73a6e3-9ea4-4539-b1c2-c55b8d86cbb4'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:02 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-cb661a48-e95f-4381-8263-1fee8508c5f3 tempest-GroupSnapshotsTest-2048302865 None] group_snapshot f354230c-c566-41bb-860b-3f187ae90d32: deleted successfully Sep 28 18:09:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fdf9f298-3b14-411b-83b4-8d2a93a6bb6a tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "cinder-quobyte-6c2efdec-f2f1-424f-8396-f769562ad017" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fdf9f298-3b14-411b-83b4-8d2a93a6bb6a tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-6c2efdec-f2f1-424f-8396-f769562ad017" acquired by "delete_volume" :: waited 0.028s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:04 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[23805032-6e90-4a24-9148-8ec7b47edfa2]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fdf9f298-3b14-411b-83b4-8d2a93a6bb6a tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:09:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:04 devstack sudo[94935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:09:04 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:04 devstack sudo[94934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017 Sep 28 18:09:04 devstack sudo[94934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:04 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.343s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:04 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager._thread_info {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:09:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread count: 28 {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:09:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread info: [<_MainThread(MainThread, started 129097393381504)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:09:05 devstack sudo[94934]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fdf9f298-3b14-411b-83b4-8d2a93a6bb6a tempest-GroupSnapshotsTest-2048302865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017" returned: 0 in 0.568s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fdf9f298-3b14-411b-83b4-8d2a93a6bb6a tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:05 devstack sudo[94942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017 Sep 28 18:09:05 devstack sudo[94942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:05 devstack sudo[94942]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fdf9f298-3b14-411b-83b4-8d2a93a6bb6a tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6c2efdec-f2f1-424f-8396-f769562ad017" returned: 0 in 0.305s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fdf9f298-3b14-411b-83b4-8d2a93a6bb6a tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-6c2efdec-f2f1-424f-8396-f769562ad017" released by "delete_volume" :: held 0.997s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:05 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-fdf9f298-3b14-411b-83b4-8d2a93a6bb6a tempest-GroupSnapshotsTest-2048302865 None] Created reservations ['c5188f29-f64a-40bf-9c74-68e7cada5f56'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:05 devstack cinder-volume[86980]: WARNING cinder.db.api [None req-fdf9f298-3b14-411b-83b4-8d2a93a6bb6a tempest-GroupSnapshotsTest-2048302865 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1197199524'] Sep 28 18:09:05 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-fdf9f298-3b14-411b-83b4-8d2a93a6bb6a tempest-GroupSnapshotsTest-2048302865 None] Created reservations ['44fb1c07-6abd-4d89-a773-5bbb0f9babb2', 'd5cc1ded-9fff-4500-ad1e-379fd67ca5e2', 'cada71ac-8017-4dae-9d51-6c5715b18478', '9d07a16a-90d8-4282-97c9-019deaf69541'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-fdf9f298-3b14-411b-83b4-8d2a93a6bb6a tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-fdf9f298-3b14-411b-83b4-8d2a93a6bb6a tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-fdf9f298-3b14-411b-83b4-8d2a93a6bb6a tempest-GroupSnapshotsTest-2048302865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-fdf9f298-3b14-411b-83b4-8d2a93a6bb6a tempest-GroupSnapshotsTest-2048302865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-fdf9f298-3b14-411b-83b4-8d2a93a6bb6a tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fdf9f298-3b14-411b-83b4-8d2a93a6bb6a tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:05 devstack sudo[94945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:09:05 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:06 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fdf9f298-3b14-411b-83b4-8d2a93a6bb6a tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.388s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:06 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-fdf9f298-3b14-411b-83b4-8d2a93a6bb6a tempest-GroupSnapshotsTest-2048302865 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:06 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-fdf9f298-3b14-411b-83b4-8d2a93a6bb6a tempest-GroupSnapshotsTest-2048302865 None] Delete group completed successfully. Sep 28 18:09:07 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-c2500318-7e1e-4bf4-aff5-926a62a54716 tempest-GroupSnapshotsTest-2048302865 None] Group tempest-GroupSnapshotsTest-Group-1360734652: creating Sep 28 18:09:07 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-c2500318-7e1e-4bf4-aff5-926a62a54716 tempest-GroupSnapshotsTest-2048302865 None] Group tempest-GroupSnapshotsTest-Group-1360734652: created successfully Sep 28 18:09:07 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-c2500318-7e1e-4bf4-aff5-926a62a54716 tempest-GroupSnapshotsTest-2048302865 None] Create group completed successfully. Sep 28 18:09:09 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:09:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Flow 'volume_create_manager' (7c4502e6-ecdd-40ee-af69-9f5d9c0fa7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c621748e-5bf4-468c-9eb9-f525a8d16a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c621748e-5bf4-468c-9eb9-f525a8d16a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-31296713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e387e29-5d87-44a6-9250-32abc3e4a4b1,host='devstack@QuobyteHD#QuobyteHD',id=5a15aee9-fe2e-4efa-8fd8-580df44022ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed6ea6a95a694eb7aebf67c31e8a6284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:09Z,use_quota=True,user_id='a1c5f38590a043f6809feec582507926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4c5f525-8fc8-4a7c-b84a-915f80b74f1e),volume_type_id=f4c5f525-8fc8-4a7c-b84a-915f80b74f1e)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7851ca-829c-4983-a8e2-ea1c9fcfbd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7851ca-829c-4983-a8e2-ea1c9fcfbd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e529285-e5f9-4ee2-a727-2ec32ee29af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e529285-e5f9-4ee2-a727-2ec32ee29af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a15aee9-fe2e-4efa-8fd8-580df44022ad', 'volume_name': 'volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eef9375-38d6-4852-a54f-b0fbba253dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eef9375-38d6-4852-a54f-b0fbba253dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ccda71f-4300-414d-92b5-e6e7351f1256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:09 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Volume 5a15aee9-fe2e-4efa-8fd8-580df44022ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad', 'volume_size': 1} Sep 28 18:09:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7e387e29-5d87-44a6-9250-32abc3e4a4b1,created_at=2026-09-28T16:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-31296713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e387e29-5d87-44a6-9250-32abc3e4a4b1,host='devstack@QuobyteHD#QuobyteHD',id=5a15aee9-fe2e-4efa-8fd8-580df44022ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed6ea6a95a694eb7aebf67c31e8a6284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:09Z,use_quota=True,user_id='a1c5f38590a043f6809feec582507926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4c5f525-8fc8-4a7c-b84a-915f80b74f1e),volume_type_id=f4c5f525-8fc8-4a7c-b84a-915f80b74f1e)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:09:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Creating volume 5a15aee9-fe2e-4efa-8fd8-580df44022ad {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:09:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:09:09 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:09:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:09 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad 1073741824 Sep 28 18:09:09 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:10 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad 1073741824" returned: 0 in 0.728s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:10 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad Sep 28 18:09:10 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:10 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad" returned: 0 in 0.448s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:10 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:09:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:10 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ccda71f-4300-414d-92b5-e6e7351f1256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:10 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67905e7d-0288-46c4-b1fa-3eaed8b37b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:10 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Volume volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad (5a15aee9-fe2e-4efa-8fd8-580df44022ad): created successfully Sep 28 18:09:10 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67905e7d-0288-46c4-b1fa-3eaed8b37b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:10 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Flow 'volume_create_manager' (7c4502e6-ecdd-40ee-af69-9f5d9c0fa7c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:10 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-15fd631e-e8fb-4c8b-a394-75ed6a58738a tempest-GroupSnapshotsTest-2048302865 None] Created volume successfully. Sep 28 18:09:12 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:09:12 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Flow 'volume_create_manager' (b7cf7775-a700-4bda-878a-d84e63a23102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:12 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e42499a-79e2-4786-9f21-a54562366d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:12 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e42499a-79e2-4786-9f21-a54562366d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-621271964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=215c48be-8f53-4662-af93-ef580b4c87e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3312cbf98a4644e7aa042a7759fdf5b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:12Z,use_quota=True,user_id='ff18269b62c64702956edfebc7022f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:12 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f14306e-e333-42e6-a6a0-9bfde2fc6ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:12 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f14306e-e333-42e6-a6a0-9bfde2fc6ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:12 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0703a43-e0be-47dd-ae81-fc2da8c382b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:12 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0703a43-e0be-47dd-ae81-fc2da8c382b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '215c48be-8f53-4662-af93-ef580b4c87e3', 'volume_name': 'volume-215c48be-8f53-4662-af93-ef580b4c87e3', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:12 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b839dd8-13e8-402a-b026-ba1570d0b936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:12 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b839dd8-13e8-402a-b026-ba1570d0b936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:12 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f44af4c-b9d3-4a63-9ef6-12be5ac02567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:12 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Volume 215c48be-8f53-4662-af93-ef580b4c87e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-215c48be-8f53-4662-af93-ef580b4c87e3', 'volume_size': 1} Sep 28 18:09:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:12 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-621271964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=215c48be-8f53-4662-af93-ef580b4c87e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3312cbf98a4644e7aa042a7759fdf5b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:12Z,use_quota=True,user_id='ff18269b62c64702956edfebc7022f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:09:12 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Creating volume 215c48be-8f53-4662-af93-ef580b4c87e3 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:09:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:12 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:12 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:12 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:09:12 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:09:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:12 devstack sudo[94959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3 1073741824 Sep 28 18:09:12 devstack sudo[94959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Flow 'volume_create_manager' (217d702f-04e8-4034-aebb-ce33e24058bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e958d0e2-34c8-4feb-8dcf-5ec9ab66ea32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e958d0e2-34c8-4feb-8dcf-5ec9ab66ea32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-497339014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e387e29-5d87-44a6-9250-32abc3e4a4b1,host='devstack@QuobyteHD#QuobyteHD',id=c29e78e9-1c0e-4065-9391-14832c13dad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed6ea6a95a694eb7aebf67c31e8a6284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:13Z,use_quota=True,user_id='a1c5f38590a043f6809feec582507926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4c5f525-8fc8-4a7c-b84a-915f80b74f1e),volume_type_id=f4c5f525-8fc8-4a7c-b84a-915f80b74f1e)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38efc6eb-d8a1-4e75-bd0c-6e23a806967e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38efc6eb-d8a1-4e75-bd0c-6e23a806967e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fda1dc4-8bd2-4b4a-bc0e-3272c0558a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fda1dc4-8bd2-4b4a-bc0e-3272c0558a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c29e78e9-1c0e-4065-9391-14832c13dad8', 'volume_name': 'volume-c29e78e9-1c0e-4065-9391-14832c13dad8', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c70859f3-590f-49c1-a18c-86221775403e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c70859f3-590f-49c1-a18c-86221775403e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee45d104-0c0d-445d-ae35-70afdc9510b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:13 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Volume c29e78e9-1c0e-4065-9391-14832c13dad8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c29e78e9-1c0e-4065-9391-14832c13dad8', 'volume_size': 1} Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:13 devstack sudo[94959]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3 1073741824" returned: 0 in 0.832s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:13 devstack sudo[94965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3 Sep 28 18:09:13 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:13 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3" returned: 0 in 0.366s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.472s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7e387e29-5d87-44a6-9250-32abc3e4a4b1,created_at=2026-09-28T16:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-497339014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e387e29-5d87-44a6-9250-32abc3e4a4b1,host='devstack@QuobyteHD#QuobyteHD',id=c29e78e9-1c0e-4065-9391-14832c13dad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed6ea6a95a694eb7aebf67c31e8a6284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:13Z,use_quota=True,user_id='a1c5f38590a043f6809feec582507926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4c5f525-8fc8-4a7c-b84a-915f80b74f1e),volume_type_id=f4c5f525-8fc8-4a7c-b84a-915f80b74f1e)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Creating volume c29e78e9-1c0e-4065-9391-14832c13dad8 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:09:13 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:13 devstack sudo[94968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8 1073741824 Sep 28 18:09:13 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f44af4c-b9d3-4a63-9ef6-12be5ac02567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-215c48be-8f53-4662-af93-ef580b4c87e3', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e0614c1-c79b-4f37-9e1b-fc09bab1bc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:13 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Volume volume-215c48be-8f53-4662-af93-ef580b4c87e3 (215c48be-8f53-4662-af93-ef580b4c87e3): created successfully Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e0614c1-c79b-4f37-9e1b-fc09bab1bc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:13 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Flow 'volume_create_manager' (b7cf7775-a700-4bda-878a-d84e63a23102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:13 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-a80418a9-d18c-4769-8b94-98d2818f8702 tempest-VolumesActionsTest-530329014 None] Created volume successfully. Sep 28 18:09:14 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8 1073741824" returned: 0 in 1.001s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:14 devstack sudo[94974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8 Sep 28 18:09:14 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:15 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8" returned: 0 in 0.423s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:15 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:09:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee45d104-0c0d-445d-ae35-70afdc9510b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c29e78e9-1c0e-4065-9391-14832c13dad8', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba689f96-a617-4270-8272-017d7a60355a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:15 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Volume volume-c29e78e9-1c0e-4065-9391-14832c13dad8 (c29e78e9-1c0e-4065-9391-14832c13dad8): created successfully Sep 28 18:09:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba689f96-a617-4270-8272-017d7a60355a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Flow 'volume_create_manager' (217d702f-04e8-4034-aebb-ce33e24058bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:15 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-93ef2574-ae66-4d5c-9eca-19cce1dfcbce tempest-GroupSnapshotsTest-2048302865 None] Created volume successfully. Sep 28 18:09:15 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-ebe554b6-411d-4ed0-87ca-a7fee122b145 tempest-GroupSnapshotsTest-2048302865 None] Update group completed successfully. Sep 28 18:09:17 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-6e88b8c2-44f6-4db7-adcc-430c3d25d39a tempest-GroupSnapshotsTest-2048302865 None] Update group completed successfully. Sep 28 18:09:18 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-fff8bb49-9482-4b40-9bd2-32008694664c tempest-GroupSnapshotsTest-2048302865 None] Update group completed successfully. Sep 28 18:09:19 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-2fdf9402-2d80-4771-9f8e-0f32faf15e79 tempest-GroupSnapshotsTest-2048302865 None] Update group completed successfully. Sep 28 18:09:21 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] GroupSnapshot 1cc326aa-ce66-43d4-898a-62bf82d0ecbb: creating. Sep 28 18:09:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] Group snapshot 1cc326aa-ce66-43d4-898a-62bf82d0ecbb: creating. {{(pid=86980) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 18:09:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:21 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] Creating offline snapshot 582db49a-e4ae-4d38-b3ed-2cbf13399992 of volume c29e78e9-1c0e-4065-9391-14832c13dad8 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:09:21 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6442d52d-3c73-4bb5-8237-319a456a6451]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:21 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8 Sep 28 18:09:21 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:21 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8" returned: 0 in 0.463s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8.582db49a-e4ae-4d38-b3ed-2cbf13399992 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:21 devstack sudo[95006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8.582db49a-e4ae-4d38-b3ed-2cbf13399992 1G Sep 28 18:09:21 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:22 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8.582db49a-e4ae-4d38-b3ed-2cbf13399992 1G" returned: 0 in 0.560s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c29e78e9-1c0e-4065-9391-14832c13dad8 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8.582db49a-e4ae-4d38-b3ed-2cbf13399992 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:22 devstack sudo[95011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c29e78e9-1c0e-4065-9391-14832c13dad8 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8.582db49a-e4ae-4d38-b3ed-2cbf13399992 Sep 28 18:09:22 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:22 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c29e78e9-1c0e-4065-9391-14832c13dad8 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8.582db49a-e4ae-4d38-b3ed-2cbf13399992" returned: 0 in 0.393s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:22 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8.582db49a-e4ae-4d38-b3ed-2cbf13399992 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:09:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8.582db49a-e4ae-4d38-b3ed-2cbf13399992 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:22 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8.582db49a-e4ae-4d38-b3ed-2cbf13399992 Sep 28 18:09:22 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:23 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8.582db49a-e4ae-4d38-b3ed-2cbf13399992" returned: 0 in 0.333s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:23 devstack sudo[95019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8.info Sep 28 18:09:23 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:23 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8.info" returned: 0 in 0.342s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:23 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:09:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:23 devstack sudo[95022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8.info Sep 28 18:09:23 devstack sudo[95022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:23 devstack sudo[95022]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8.info" returned: 0 in 0.338s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.550s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] Creating offline snapshot 6054ede3-4e83-4ae6-a42a-b2aab982db34 of volume 5a15aee9-fe2e-4efa-8fd8-580df44022ad {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:09:23 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31c4acc-893f-4fbb-8af3-39a11907dbda]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:24 devstack sudo[95025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad Sep 28 18:09:24 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:24 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad" returned: 0 in 0.497s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad.6054ede3-4e83-4ae6-a42a-b2aab982db34 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:24 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad.6054ede3-4e83-4ae6-a42a-b2aab982db34 1G Sep 28 18:09:24 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:25 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad.6054ede3-4e83-4ae6-a42a-b2aab982db34 1G" returned: 0 in 0.623s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad.6054ede3-4e83-4ae6-a42a-b2aab982db34 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:25 devstack sudo[95036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad.6054ede3-4e83-4ae6-a42a-b2aab982db34 Sep 28 18:09:25 devstack sudo[95036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:25 devstack sudo[95036]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad.6054ede3-4e83-4ae6-a42a-b2aab982db34" returned: 0 in 0.381s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:25 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad.6054ede3-4e83-4ae6-a42a-b2aab982db34 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:09:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad.6054ede3-4e83-4ae6-a42a-b2aab982db34 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:25 devstack sudo[95042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad.6054ede3-4e83-4ae6-a42a-b2aab982db34 Sep 28 18:09:25 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:25 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad.6054ede3-4e83-4ae6-a42a-b2aab982db34" returned: 0 in 0.342s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:25 devstack sudo[95045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad.info Sep 28 18:09:25 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:26 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad.info" returned: 0 in 0.354s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:26 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:09:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:26 devstack sudo[95048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad.info Sep 28 18:09:26 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:26 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad.info" returned: 0 in 0.337s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.657s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:26 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-3483ccb5-dc29-4c2c-9efd-621deed5093c tempest-GroupSnapshotsTest-2048302865 None] group_snapshot 1cc326aa-ce66-43d4-898a-62bf82d0ecbb: created successfully Sep 28 18:09:27 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] group_snapshot 1cc326aa-ce66-43d4-898a-62bf82d0ecbb: deleting Sep 28 18:09:27 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] group_snapshot 1cc326aa-ce66-43d4-898a-62bf82d0ecbb: deleting {{(pid=86980) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 18:09:27 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "cinder-quobyte-c29e78e9-1c0e-4065-9391-14832c13dad8" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:28 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-c29e78e9-1c0e-4065-9391-14832c13dad8" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:28 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "cinder-quobyte-582db49a-e4ae-4d38-b3ed-2cbf13399992" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:28 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-582db49a-e4ae-4d38-b3ed-2cbf13399992" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:28 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] Deleting offline snapshot 582db49a-e4ae-4d38-b3ed-2cbf13399992 of volume c29e78e9-1c0e-4065-9391-14832c13dad8 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:09:28 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] snapshot_file for this snap is: volume-c29e78e9-1c0e-4065-9391-14832c13dad8.582db49a-e4ae-4d38-b3ed-2cbf13399992 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:09:28 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba05f24-ebe5-44ed-a6f8-13f810b3c760]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8.582db49a-e4ae-4d38-b3ed-2cbf13399992 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:28 devstack sudo[95052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8.582db49a-e4ae-4d38-b3ed-2cbf13399992 Sep 28 18:09:28 devstack sudo[95052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:28 devstack sudo[95052]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8.582db49a-e4ae-4d38-b3ed-2cbf13399992" returned: 0 in 0.652s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:28 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c29e78e9-1c0e-4065-9391-14832c13dad8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:09:28 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a1705a-0801-4d0a-80c3-da94e9335a44]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:29 devstack sudo[95058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8 Sep 28 18:09:29 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:29 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8" returned: 0 in 0.455s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8.582db49a-e4ae-4d38-b3ed-2cbf13399992 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:29 devstack sudo[95063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8.582db49a-e4ae-4d38-b3ed-2cbf13399992 Sep 28 18:09:29 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:29 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8.582db49a-e4ae-4d38-b3ed-2cbf13399992" returned: 0 in 0.465s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8.582db49a-e4ae-4d38-b3ed-2cbf13399992 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:29 devstack sudo[95069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8.582db49a-e4ae-4d38-b3ed-2cbf13399992 Sep 28 18:09:29 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:30 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8.582db49a-e4ae-4d38-b3ed-2cbf13399992" returned: 0 in 0.344s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:30 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-582db49a-e4ae-4d38-b3ed-2cbf13399992" released by "_delete_snapshot" :: held 2.133s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:30 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-c29e78e9-1c0e-4065-9391-14832c13dad8" released by "delete_snapshot" :: held 2.189s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:30 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "cinder-quobyte-5a15aee9-fe2e-4efa-8fd8-580df44022ad" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:30 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-5a15aee9-fe2e-4efa-8fd8-580df44022ad" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:30 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "cinder-quobyte-6054ede3-4e83-4ae6-a42a-b2aab982db34" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:30 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-6054ede3-4e83-4ae6-a42a-b2aab982db34" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:30 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] Deleting offline snapshot 6054ede3-4e83-4ae6-a42a-b2aab982db34 of volume 5a15aee9-fe2e-4efa-8fd8-580df44022ad {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:09:30 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] snapshot_file for this snap is: volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad.6054ede3-4e83-4ae6-a42a-b2aab982db34 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:09:30 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f1a8f2-217c-419a-8356-aa7e93b0f814]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad.6054ede3-4e83-4ae6-a42a-b2aab982db34 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:30 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad.6054ede3-4e83-4ae6-a42a-b2aab982db34 Sep 28 18:09:30 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:30 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad.6054ede3-4e83-4ae6-a42a-b2aab982db34" returned: 0 in 0.613s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:30 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:09:30 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e65b4f-29f6-46ac-88a2-3c289ebb57bd]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:31 devstack sudo[95078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad Sep 28 18:09:31 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:31 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad" returned: 0 in 0.503s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad.6054ede3-4e83-4ae6-a42a-b2aab982db34 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:31 devstack sudo[95084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad.6054ede3-4e83-4ae6-a42a-b2aab982db34 Sep 28 18:09:31 devstack sudo[95084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:32 devstack sudo[95084]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad.6054ede3-4e83-4ae6-a42a-b2aab982db34" returned: 0 in 0.844s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad.6054ede3-4e83-4ae6-a42a-b2aab982db34 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:32 devstack sudo[95117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad.6054ede3-4e83-4ae6-a42a-b2aab982db34 Sep 28 18:09:32 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:32 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad.6054ede3-4e83-4ae6-a42a-b2aab982db34" returned: 0 in 0.610s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:33 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-6054ede3-4e83-4ae6-a42a-b2aab982db34" released by "_delete_snapshot" :: held 2.770s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:33 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-5a15aee9-fe2e-4efa-8fd8-580df44022ad" released by "delete_snapshot" :: held 2.807s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:33 devstack cinder-volume[86980]: WARNING cinder.quota [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1446222012 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1446222012, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:09:33 devstack cinder-volume[86980]: WARNING cinder.quota [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1446222012 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1446222012, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:09:33 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] Created reservations ['3afcff1f-bbc3-4b44-af27-aa76f3cc6b3e', 'd127f728-416c-45b5-b1ed-c866eff90b0f', '7ff1e9d1-057a-4f21-ac62-ce33a499a739', '0e46251a-98cd-4d9e-8dba-a0491392c435'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:33 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] Created reservations ['ef940783-9f90-4a07-bc55-34264ca5a905', '63842dea-f81c-48e8-a13e-ba0048f00482', '8400ad05-3d71-4678-adc9-72c6bc30c764', '3a8e81e0-08b7-4fae-8ca9-555da3a87965'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:33 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-28808597-8dcc-4368-8996-4a17674e2e21 tempest-GroupSnapshotsTest-2048302865 None] group_snapshot 1cc326aa-ce66-43d4-898a-62bf82d0ecbb: deleted successfully Sep 28 18:09:34 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1f469f97-8cdf-4d97-acf2-21f7a852bead tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "cinder-quobyte-5a15aee9-fe2e-4efa-8fd8-580df44022ad" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:34 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1f469f97-8cdf-4d97-acf2-21f7a852bead tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-5a15aee9-fe2e-4efa-8fd8-580df44022ad" acquired by "delete_volume" :: waited 0.024s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:34 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[83898b11-adae-42e0-b7bf-304c58e052f9]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1f469f97-8cdf-4d97-acf2-21f7a852bead tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:35 devstack sudo[95174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad Sep 28 18:09:35 devstack sudo[95174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:35 devstack sudo[95174]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1f469f97-8cdf-4d97-acf2-21f7a852bead tempest-GroupSnapshotsTest-2048302865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad" returned: 0 in 0.698s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1f469f97-8cdf-4d97-acf2-21f7a852bead tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:35 devstack sudo[95181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad Sep 28 18:09:35 devstack sudo[95181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:36 devstack sudo[95181]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1f469f97-8cdf-4d97-acf2-21f7a852bead tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a15aee9-fe2e-4efa-8fd8-580df44022ad" returned: 0 in 0.728s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:36 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1f469f97-8cdf-4d97-acf2-21f7a852bead tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-5a15aee9-fe2e-4efa-8fd8-580df44022ad" released by "delete_volume" :: held 1.577s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:36 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1f469f97-8cdf-4d97-acf2-21f7a852bead tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "cinder-quobyte-c29e78e9-1c0e-4065-9391-14832c13dad8" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:36 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1f469f97-8cdf-4d97-acf2-21f7a852bead tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-c29e78e9-1c0e-4065-9391-14832c13dad8" acquired by "delete_volume" :: waited 0.025s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:36 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[96489c01-5f23-4680-ac26-83e71399e553]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1f469f97-8cdf-4d97-acf2-21f7a852bead tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:36 devstack sudo[95184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8 Sep 28 18:09:36 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:37 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1f469f97-8cdf-4d97-acf2-21f7a852bead tempest-GroupSnapshotsTest-2048302865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8" returned: 0 in 0.696s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1f469f97-8cdf-4d97-acf2-21f7a852bead tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:37 devstack sudo[95189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8 Sep 28 18:09:37 devstack sudo[95189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:37 devstack sudo[95189]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1f469f97-8cdf-4d97-acf2-21f7a852bead tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c29e78e9-1c0e-4065-9391-14832c13dad8" returned: 0 in 0.548s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:37 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1f469f97-8cdf-4d97-acf2-21f7a852bead tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-c29e78e9-1c0e-4065-9391-14832c13dad8" released by "delete_volume" :: held 1.397s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:37 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-1f469f97-8cdf-4d97-acf2-21f7a852bead tempest-GroupSnapshotsTest-2048302865 None] Created reservations ['8baaef13-0450-4c0d-8b9d-a4e04c86475e'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:37 devstack cinder-volume[86980]: WARNING cinder.quota [None req-1f469f97-8cdf-4d97-acf2-21f7a852bead tempest-GroupSnapshotsTest-2048302865 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1446222012 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1446222012, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:09:37 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-1f469f97-8cdf-4d97-acf2-21f7a852bead tempest-GroupSnapshotsTest-2048302865 None] Created reservations ['91b1dc6f-926b-46a9-8e89-156ea627baeb', 'a21f37dc-2933-4ae3-8252-ed4791ae0c94', 'dc170a3e-a7f3-446f-beaf-186a57ef56c9', '47a1dc44-80e3-4fcb-813c-6a4acbc187ed'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:38 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-1f469f97-8cdf-4d97-acf2-21f7a852bead tempest-GroupSnapshotsTest-2048302865 None] Created reservations ['e0c84aae-1a16-4c11-871f-7295ef32b89f', '9075e2c1-f803-4623-b58f-409dc6c9292c', '75b60cfb-059b-4a1c-8000-e3ea17b41073', '63a2b4e9-6137-4fd0-8bf8-c9185acbee96'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1f469f97-8cdf-4d97-acf2-21f7a852bead tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1f469f97-8cdf-4d97-acf2-21f7a852bead tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1f469f97-8cdf-4d97-acf2-21f7a852bead tempest-GroupSnapshotsTest-2048302865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1f469f97-8cdf-4d97-acf2-21f7a852bead tempest-GroupSnapshotsTest-2048302865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1f469f97-8cdf-4d97-acf2-21f7a852bead tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1f469f97-8cdf-4d97-acf2-21f7a852bead tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:38 devstack sudo[95192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:09:38 devstack sudo[95192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:39 devstack sudo[95192]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1f469f97-8cdf-4d97-acf2-21f7a852bead tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.544s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:39 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-1f469f97-8cdf-4d97-acf2-21f7a852bead tempest-GroupSnapshotsTest-2048302865 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:09:39 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-1f469f97-8cdf-4d97-acf2-21f7a852bead tempest-GroupSnapshotsTest-2048302865 None] Delete group completed successfully. Sep 28 18:09:39 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-a865c6a4-5d23-48a1-bb22-885d29437284 tempest-GroupSnapshotsTest-2048302865 None] Group tempest-GroupSnapshotsTest-Group-16648176: creating Sep 28 18:09:39 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-a865c6a4-5d23-48a1-bb22-885d29437284 tempest-GroupSnapshotsTest-2048302865 None] Group tempest-GroupSnapshotsTest-Group-16648176: created successfully Sep 28 18:09:39 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-a865c6a4-5d23-48a1-bb22-885d29437284 tempest-GroupSnapshotsTest-2048302865 None] Create group completed successfully. Sep 28 18:09:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-21d21f79-5c51-45e8-b8b5-7ecb6007293f tempest-VolumesActionsTest-530329014 None] Acquiring lock "cinder-215c48be-8f53-4662-af93-ef580b4c87e3" by "attach_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-21d21f79-5c51-45e8-b8b5-7ecb6007293f tempest-VolumesActionsTest-530329014 None] Lock "cinder-215c48be-8f53-4662-af93-ef580b4c87e3" acquired by "attach_volume" :: waited 0.029s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:39 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-21d21f79-5c51-45e8-b8b5-7ecb6007293f tempest-VolumesActionsTest-530329014 None] Attaching volume 215c48be-8f53-4662-af93-ef580b4c87e3 to instance bf593abf-3cca-42f2-bd50-eacc80feb38f at mountpoint /dev/vdb on host None. Sep 28 18:09:40 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-21d21f79-5c51-45e8-b8b5-7ecb6007293f tempest-VolumesActionsTest-530329014 None] Attach volume completed successfully. Sep 28 18:09:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-21d21f79-5c51-45e8-b8b5-7ecb6007293f tempest-VolumesActionsTest-530329014 None] Lock "cinder-215c48be-8f53-4662-af93-ef580b4c87e3" released by "attach_volume" :: held 0.136s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-60c7eb70-298a-4c53-8d9d-82d53f58b14c tempest-VolumesActionsTest-530329014 None] Acquiring lock "cinder-215c48be-8f53-4662-af93-ef580b4c87e3-detach_volume" by "detach_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-60c7eb70-298a-4c53-8d9d-82d53f58b14c tempest-VolumesActionsTest-530329014 None] Lock "cinder-215c48be-8f53-4662-af93-ef580b4c87e3-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:40 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-60c7eb70-298a-4c53-8d9d-82d53f58b14c tempest-VolumesActionsTest-530329014 None] Detaching volume 215c48be-8f53-4662-af93-ef580b4c87e3 from instance bf593abf-3cca-42f2-bd50-eacc80feb38f. Sep 28 18:09:40 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-60c7eb70-298a-4c53-8d9d-82d53f58b14c tempest-VolumesActionsTest-530329014 None] Detach volume completed successfully. Sep 28 18:09:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-60c7eb70-298a-4c53-8d9d-82d53f58b14c tempest-VolumesActionsTest-530329014 None] Lock "cinder-215c48be-8f53-4662-af93-ef580b4c87e3-detach_volume" released by "detach_volume" :: held 0.092s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:42 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:09:42 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Flow 'volume_create_manager' (ca889b7c-f488-4411-a61a-84ad2f704816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:42 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356066a5-28b4-44f0-9a47-73e7674b6556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:42 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356066a5-28b4-44f0-9a47-73e7674b6556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-506017414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=34cf01d5-fc00-4db9-8064-a4fb4e32a0a7,host='devstack@QuobyteHD#QuobyteHD',id=86c078d3-baa1-46de-a8d0-70c8c55e9403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed6ea6a95a694eb7aebf67c31e8a6284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:42Z,use_quota=True,user_id='a1c5f38590a043f6809feec582507926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(761c9377-07e8-45d3-90fa-f15aa3c0496f),volume_type_id=761c9377-07e8-45d3-90fa-f15aa3c0496f)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:42 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3062b42e-b2e3-4539-b861-8e67169a63d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:42 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3062b42e-b2e3-4539-b861-8e67169a63d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:42 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a12902-4c6d-49c5-b1ff-e9176d5bf772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:42 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a12902-4c6d-49c5-b1ff-e9176d5bf772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86c078d3-baa1-46de-a8d0-70c8c55e9403', 'volume_name': 'volume-86c078d3-baa1-46de-a8d0-70c8c55e9403', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:42 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47630a8a-6992-4aae-b1b6-0993421d2d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:42 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47630a8a-6992-4aae-b1b6-0993421d2d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:42 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62d659a8-a1e0-4999-a16a-ae4f829b1e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:42 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Volume 86c078d3-baa1-46de-a8d0-70c8c55e9403: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86c078d3-baa1-46de-a8d0-70c8c55e9403', 'volume_size': 1} Sep 28 18:09:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=34cf01d5-fc00-4db9-8064-a4fb4e32a0a7,created_at=2026-09-28T16:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-506017414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=34cf01d5-fc00-4db9-8064-a4fb4e32a0a7,host='devstack@QuobyteHD#QuobyteHD',id=86c078d3-baa1-46de-a8d0-70c8c55e9403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed6ea6a95a694eb7aebf67c31e8a6284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:42Z,use_quota=True,user_id='a1c5f38590a043f6809feec582507926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(761c9377-07e8-45d3-90fa-f15aa3c0496f),volume_type_id=761c9377-07e8-45d3-90fa-f15aa3c0496f)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:09:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Creating volume 86c078d3-baa1-46de-a8d0-70c8c55e9403 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:09:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:09:42 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:09:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:42 devstack sudo[95229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403 1073741824 Sep 28 18:09:42 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:43 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403 1073741824" returned: 0 in 0.930s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:43 devstack sudo[95255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403 Sep 28 18:09:43 devstack sudo[95255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:43 devstack sudo[95255]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403" returned: 0 in 0.419s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:09:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62d659a8-a1e0-4999-a16a-ae4f829b1e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86c078d3-baa1-46de-a8d0-70c8c55e9403', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9730774a-9eaa-4cba-9c1f-efe96d377645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:44 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Volume volume-86c078d3-baa1-46de-a8d0-70c8c55e9403 (86c078d3-baa1-46de-a8d0-70c8c55e9403): created successfully Sep 28 18:09:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9730774a-9eaa-4cba-9c1f-efe96d377645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Flow 'volume_create_manager' (ca889b7c-f488-4411-a61a-84ad2f704816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:44 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-b1ad28c1-863a-4c75-885f-8a0382ce9787 tempest-GroupSnapshotsTest-2048302865 None] Created volume successfully. Sep 28 18:09:45 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-0c4d65e8-583e-48e2-9413-e7bdbb6a9144 tempest-GroupSnapshotsTest-2048302865 None] GroupSnapshot a6d8caf9-2c0b-44a4-bebf-34f1c1937767: creating. Sep 28 18:09:45 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0c4d65e8-583e-48e2-9413-e7bdbb6a9144 tempest-GroupSnapshotsTest-2048302865 None] Group snapshot a6d8caf9-2c0b-44a4-bebf-34f1c1937767: creating. {{(pid=86980) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 18:09:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0c4d65e8-583e-48e2-9413-e7bdbb6a9144 tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0c4d65e8-583e-48e2-9413-e7bdbb6a9144 tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:45 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-0c4d65e8-583e-48e2-9413-e7bdbb6a9144 tempest-GroupSnapshotsTest-2048302865 None] Creating offline snapshot ba4c2baa-e7c0-4dc6-9528-e7e50bae05f0 of volume 86c078d3-baa1-46de-a8d0-70c8c55e9403 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:09:45 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64696f2-3760-44d4-a8e3-155c4800e7fc]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0c4d65e8-583e-48e2-9413-e7bdbb6a9144 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:45 devstack sudo[95273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403 Sep 28 18:09:45 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:46 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0c4d65e8-583e-48e2-9413-e7bdbb6a9144 tempest-GroupSnapshotsTest-2048302865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403" returned: 0 in 0.629s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0c4d65e8-583e-48e2-9413-e7bdbb6a9144 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403.ba4c2baa-e7c0-4dc6-9528-e7e50bae05f0 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:46 devstack sudo[95284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403.ba4c2baa-e7c0-4dc6-9528-e7e50bae05f0 1G Sep 28 18:09:46 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:47 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0c4d65e8-583e-48e2-9413-e7bdbb6a9144 tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403.ba4c2baa-e7c0-4dc6-9528-e7e50bae05f0 1G" returned: 0 in 0.582s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0c4d65e8-583e-48e2-9413-e7bdbb6a9144 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86c078d3-baa1-46de-a8d0-70c8c55e9403 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403.ba4c2baa-e7c0-4dc6-9528-e7e50bae05f0 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:47 devstack sudo[95289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86c078d3-baa1-46de-a8d0-70c8c55e9403 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403.ba4c2baa-e7c0-4dc6-9528-e7e50bae05f0 Sep 28 18:09:47 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:47 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0c4d65e8-583e-48e2-9413-e7bdbb6a9144 tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86c078d3-baa1-46de-a8d0-70c8c55e9403 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403.ba4c2baa-e7c0-4dc6-9528-e7e50bae05f0" returned: 0 in 0.664s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:47 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-0c4d65e8-583e-48e2-9413-e7bdbb6a9144 tempest-GroupSnapshotsTest-2048302865 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403.ba4c2baa-e7c0-4dc6-9528-e7e50bae05f0 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:09:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0c4d65e8-583e-48e2-9413-e7bdbb6a9144 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403.ba4c2baa-e7c0-4dc6-9528-e7e50bae05f0 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:47 devstack sudo[95321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403.ba4c2baa-e7c0-4dc6-9528-e7e50bae05f0 Sep 28 18:09:47 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:48 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0c4d65e8-583e-48e2-9413-e7bdbb6a9144 tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403.ba4c2baa-e7c0-4dc6-9528-e7e50bae05f0" returned: 0 in 0.816s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0c4d65e8-583e-48e2-9413-e7bdbb6a9144 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:48 devstack sudo[95387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403.info Sep 28 18:09:48 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:49 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0c4d65e8-583e-48e2-9413-e7bdbb6a9144 tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403.info" returned: 0 in 0.614s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:49 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-0c4d65e8-583e-48e2-9413-e7bdbb6a9144 tempest-GroupSnapshotsTest-2048302865 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:09:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0c4d65e8-583e-48e2-9413-e7bdbb6a9144 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:49 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403.info Sep 28 18:09:49 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:49 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0c4d65e8-583e-48e2-9413-e7bdbb6a9144 tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403.info" returned: 0 in 0.347s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0c4d65e8-583e-48e2-9413-e7bdbb6a9144 tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.862s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:49 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-0c4d65e8-583e-48e2-9413-e7bdbb6a9144 tempest-GroupSnapshotsTest-2048302865 None] group_snapshot a6d8caf9-2c0b-44a4-bebf-34f1c1937767: created successfully Sep 28 18:09:50 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-3c2e1c22-4b1a-46b8-b528-57b3032c7755 tempest-GroupSnapshotsTest-2048302865 None] group_snapshot a6d8caf9-2c0b-44a4-bebf-34f1c1937767: deleting Sep 28 18:09:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3c2e1c22-4b1a-46b8-b528-57b3032c7755 tempest-GroupSnapshotsTest-2048302865 None] group_snapshot a6d8caf9-2c0b-44a4-bebf-34f1c1937767: deleting {{(pid=86980) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 18:09:50 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3c2e1c22-4b1a-46b8-b528-57b3032c7755 tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "cinder-quobyte-86c078d3-baa1-46de-a8d0-70c8c55e9403" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:50 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3c2e1c22-4b1a-46b8-b528-57b3032c7755 tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-86c078d3-baa1-46de-a8d0-70c8c55e9403" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:50 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3c2e1c22-4b1a-46b8-b528-57b3032c7755 tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "cinder-quobyte-ba4c2baa-e7c0-4dc6-9528-e7e50bae05f0" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:50 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3c2e1c22-4b1a-46b8-b528-57b3032c7755 tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-ba4c2baa-e7c0-4dc6-9528-e7e50bae05f0" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-3c2e1c22-4b1a-46b8-b528-57b3032c7755 tempest-GroupSnapshotsTest-2048302865 None] Deleting offline snapshot ba4c2baa-e7c0-4dc6-9528-e7e50bae05f0 of volume 86c078d3-baa1-46de-a8d0-70c8c55e9403 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:09:51 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-3c2e1c22-4b1a-46b8-b528-57b3032c7755 tempest-GroupSnapshotsTest-2048302865 None] snapshot_file for this snap is: volume-86c078d3-baa1-46de-a8d0-70c8c55e9403.ba4c2baa-e7c0-4dc6-9528-e7e50bae05f0 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:09:51 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[648db15d-825d-4dea-97b8-7964e0c7118c]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3c2e1c22-4b1a-46b8-b528-57b3032c7755 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403.ba4c2baa-e7c0-4dc6-9528-e7e50bae05f0 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:51 devstack sudo[95474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403.ba4c2baa-e7c0-4dc6-9528-e7e50bae05f0 Sep 28 18:09:51 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:52 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3c2e1c22-4b1a-46b8-b528-57b3032c7755 tempest-GroupSnapshotsTest-2048302865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403.ba4c2baa-e7c0-4dc6-9528-e7e50bae05f0" returned: 0 in 1.379s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:52 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-3c2e1c22-4b1a-46b8-b528-57b3032c7755 tempest-GroupSnapshotsTest-2048302865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86c078d3-baa1-46de-a8d0-70c8c55e9403(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:09:52 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa3a334-a6a2-4627-9a6c-e4c53259f596]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3c2e1c22-4b1a-46b8-b528-57b3032c7755 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:52 devstack sudo[95508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403 Sep 28 18:09:53 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:53 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3c2e1c22-4b1a-46b8-b528-57b3032c7755 tempest-GroupSnapshotsTest-2048302865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403" returned: 0 in 0.925s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3c2e1c22-4b1a-46b8-b528-57b3032c7755 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403.ba4c2baa-e7c0-4dc6-9528-e7e50bae05f0 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:53 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403.ba4c2baa-e7c0-4dc6-9528-e7e50bae05f0 Sep 28 18:09:53 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:54 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3c2e1c22-4b1a-46b8-b528-57b3032c7755 tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403.ba4c2baa-e7c0-4dc6-9528-e7e50bae05f0" returned: 0 in 0.859s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3c2e1c22-4b1a-46b8-b528-57b3032c7755 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403.ba4c2baa-e7c0-4dc6-9528-e7e50bae05f0 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:54 devstack sudo[95524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403.ba4c2baa-e7c0-4dc6-9528-e7e50bae05f0 Sep 28 18:09:54 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:55 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3c2e1c22-4b1a-46b8-b528-57b3032c7755 tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403.ba4c2baa-e7c0-4dc6-9528-e7e50bae05f0" returned: 0 in 1.119s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3c2e1c22-4b1a-46b8-b528-57b3032c7755 tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-ba4c2baa-e7c0-4dc6-9528-e7e50bae05f0" released by "_delete_snapshot" :: held 4.660s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3c2e1c22-4b1a-46b8-b528-57b3032c7755 tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-86c078d3-baa1-46de-a8d0-70c8c55e9403" released by "delete_snapshot" :: held 4.722s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:09:55 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=93,cinder:UPDATE=86,cinder:INSERT=18,cinder:DELETE=1 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:09:55 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:UPDATE=89,cinder:INSERT=23,cinder:SELECT=93,cinder:DELETE=3 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:09:55 devstack cinder-volume[86980]: WARNING cinder.quota [None req-3c2e1c22-4b1a-46b8-b528-57b3032c7755 tempest-GroupSnapshotsTest-2048302865 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1774522512 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1774522512, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:09:55 devstack cinder-volume[86980]: WARNING cinder.quota [None req-3c2e1c22-4b1a-46b8-b528-57b3032c7755 tempest-GroupSnapshotsTest-2048302865 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1774522512 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1774522512, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:09:55 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-3c2e1c22-4b1a-46b8-b528-57b3032c7755 tempest-GroupSnapshotsTest-2048302865 None] Created reservations ['66211659-fa95-4a97-9aa7-e248345d94c3', '33ef4287-bbd5-4442-8029-ade1dbe690ad', '492b14fb-e704-4fe7-a695-ba54dac304f3', 'a27ef8cf-bcc3-40bb-9fee-bc8bda160fc1'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:09:56 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-3c2e1c22-4b1a-46b8-b528-57b3032c7755 tempest-GroupSnapshotsTest-2048302865 None] group_snapshot a6d8caf9-2c0b-44a4-bebf-34f1c1937767: deleted successfully Sep 28 18:09:58 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ebc4777c-5d3a-4a29-9f5e-616a9e0c3629 tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "cinder-quobyte-86c078d3-baa1-46de-a8d0-70c8c55e9403" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:09:58 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ebc4777c-5d3a-4a29-9f5e-616a9e0c3629 tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-86c078d3-baa1-46de-a8d0-70c8c55e9403" acquired by "delete_volume" :: waited 0.069s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:09:58 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c367db61-671e-4a4b-b81d-ddb7df73e99f]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:09:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ebc4777c-5d3a-4a29-9f5e-616a9e0c3629 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:58 devstack sudo[95546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403 Sep 28 18:09:58 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:59 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:09:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Flow 'volume_create_manager' (a3ea51bc-4141-4688-b187-3868a03b2432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:09:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b6a4cb-83c1-4b3f-a2cc-c9844d5a847b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:59 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root Sep 28 18:09:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ebc4777c-5d3a-4a29-9f5e-616a9e0c3629 tempest-GroupSnapshotsTest-2048302865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403" returned: 0 in 1.111s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:09:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ebc4777c-5d3a-4a29-9f5e-616a9e0c3629 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b6a4cb-83c1-4b3f-a2cc-c9844d5a847b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1437287054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9a848f6-6bbe-4d8b-b676-ec9a053b329b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0747e3ae27144c098ba8696ad30b939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:59Z,use_quota=True,user_id='c382dfb8494c42978fbb04237342a584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc15d66f-6091-4c38-9094-1febd4074c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc15d66f-6091-4c38-9094-1febd4074c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (725f81d7-7f4a-42a3-922f-69c3b2369e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (725f81d7-7f4a-42a3-922f-69c3b2369e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9a848f6-6bbe-4d8b-b676-ec9a053b329b', 'volume_name': 'volume-d9a848f6-6bbe-4d8b-b676-ec9a053b329b', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a643972c-2bfc-4aee-aae2-dfe76fd28aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a643972c-2bfc-4aee-aae2-dfe76fd28aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:09:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b15aa6e-a87f-458e-89ae-46d7830d6793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:09:59 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Volume d9a848f6-6bbe-4d8b-b676-ec9a053b329b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9a848f6-6bbe-4d8b-b676-ec9a053b329b', 'volume_size': 1} Sep 28 18:09:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:59 devstack sudo[95557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403 Sep 28 18:09:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1437287054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9a848f6-6bbe-4d8b-b676-ec9a053b329b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0747e3ae27144c098ba8696ad30b939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:09:59Z,use_quota=True,user_id='c382dfb8494c42978fbb04237342a584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:09:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Creating volume d9a848f6-6bbe-4d8b-b676-ec9a053b329b {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:09:59 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:09:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:09:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:09:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:09:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:09:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:09:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:09:59 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:09:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d9a848f6-6bbe-4d8b-b676-ec9a053b329b 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:09:59 devstack sudo[95559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d9a848f6-6bbe-4d8b-b676-ec9a053b329b 1073741824 Sep 28 18:09:59 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:00 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ebc4777c-5d3a-4a29-9f5e-616a9e0c3629 tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-86c078d3-baa1-46de-a8d0-70c8c55e9403" returned: 0 in 0.834s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ebc4777c-5d3a-4a29-9f5e-616a9e0c3629 tempest-GroupSnapshotsTest-2048302865 None] Lock "cinder-quobyte-86c078d3-baa1-46de-a8d0-70c8c55e9403" released by "delete_volume" :: held 2.130s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:00 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-ebc4777c-5d3a-4a29-9f5e-616a9e0c3629 tempest-GroupSnapshotsTest-2048302865 None] Created reservations ['7ea12dd2-7e96-4d86-a3f8-0ba46b6299c3'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:10:00 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:00 devstack cinder-volume[86980]: WARNING cinder.quota [None req-ebc4777c-5d3a-4a29-9f5e-616a9e0c3629 tempest-GroupSnapshotsTest-2048302865 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1774522512 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1774522512, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:10:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d9a848f6-6bbe-4d8b-b676-ec9a053b329b 1073741824" returned: 0 in 1.054s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:00 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-ebc4777c-5d3a-4a29-9f5e-616a9e0c3629 tempest-GroupSnapshotsTest-2048302865 None] Created reservations ['8dd8d011-d076-4faa-b651-381b47923a16', '3be0b68a-7dab-4b18-9b29-9d3f0cded0f8', 'b2d49000-386e-4003-8d97-2e140e53ffb9', '68d2b5b7-b24b-4754-a49a-db0188d79d8d'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:10:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d9a848f6-6bbe-4d8b-b676-ec9a053b329b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:00 devstack sudo[95567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d9a848f6-6bbe-4d8b-b676-ec9a053b329b Sep 28 18:10:00 devstack sudo[95567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ebc4777c-5d3a-4a29-9f5e-616a9e0c3629 tempest-GroupSnapshotsTest-2048302865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ebc4777c-5d3a-4a29-9f5e-616a9e0c3629 tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ebc4777c-5d3a-4a29-9f5e-616a9e0c3629 tempest-GroupSnapshotsTest-2048302865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ebc4777c-5d3a-4a29-9f5e-616a9e0c3629 tempest-GroupSnapshotsTest-2048302865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ebc4777c-5d3a-4a29-9f5e-616a9e0c3629 tempest-GroupSnapshotsTest-2048302865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ebc4777c-5d3a-4a29-9f5e-616a9e0c3629 tempest-GroupSnapshotsTest-2048302865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:00 devstack sudo[95570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:10:00 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:01 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ebc4777c-5d3a-4a29-9f5e-616a9e0c3629 tempest-GroupSnapshotsTest-2048302865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.532s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:01 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-ebc4777c-5d3a-4a29-9f5e-616a9e0c3629 tempest-GroupSnapshotsTest-2048302865 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:10:01 devstack sudo[95567]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:01 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-ebc4777c-5d3a-4a29-9f5e-616a9e0c3629 tempest-GroupSnapshotsTest-2048302865 None] Delete group completed successfully. Sep 28 18:10:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d9a848f6-6bbe-4d8b-b676-ec9a053b329b" returned: 0 in 0.776s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] <== create_volume: return (1947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:10:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.950s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b15aa6e-a87f-458e-89ae-46d7830d6793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9a848f6-6bbe-4d8b-b676-ec9a053b329b', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6bd7f3-22ef-47d0-ac2a-d97ce0a4f006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:01 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Volume volume-d9a848f6-6bbe-4d8b-b676-ec9a053b329b (d9a848f6-6bbe-4d8b-b676-ec9a053b329b): created successfully Sep 28 18:10:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6bd7f3-22ef-47d0-ac2a-d97ce0a4f006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Flow 'volume_create_manager' (a3ea51bc-4141-4688-b187-3868a03b2432) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:01 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-cf570690-dd20-4047-a16b-936a76752c64 tempest-VolumesActionsTest-1955705005 None] Created volume successfully. Sep 28 18:10:02 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-70b20644-ca47-468c-a824-e7fb4b7dcf0c tempest-VolumesActionsTest-1955705005 None] Acquiring lock "cinder-d9a848f6-6bbe-4d8b-b676-ec9a053b329b" by "attach_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:02 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-70b20644-ca47-468c-a824-e7fb4b7dcf0c tempest-VolumesActionsTest-1955705005 None] Lock "cinder-d9a848f6-6bbe-4d8b-b676-ec9a053b329b" acquired by "attach_volume" :: waited 0.060s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:03 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-70b20644-ca47-468c-a824-e7fb4b7dcf0c tempest-VolumesActionsTest-1955705005 None] Attaching volume d9a848f6-6bbe-4d8b-b676-ec9a053b329b to instance 29381003-ae01-4943-a5ff-ddd9db10aa1a at mountpoint /dev/vdb on host None. Sep 28 18:10:03 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-70b20644-ca47-468c-a824-e7fb4b7dcf0c tempest-VolumesActionsTest-1955705005 None] Attach volume completed successfully. Sep 28 18:10:03 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-70b20644-ca47-468c-a824-e7fb4b7dcf0c tempest-VolumesActionsTest-1955705005 None] Lock "cinder-d9a848f6-6bbe-4d8b-b676-ec9a053b329b" released by "attach_volume" :: held 0.416s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:10:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:04 devstack sudo[95635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:10:04 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:05 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.872s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:05 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:10:05 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager._thread_info {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:10:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread count: 28 {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:10:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread info: [<_MainThread(MainThread, started 129097393381504)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:10:05 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-e2b0272b-225b-4206-8c33-b588afa78f61 tempest-VolumesActionsTest-807172941 None] Terminate volume connection completed successfully. Sep 28 18:10:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e2b0272b-225b-4206-8c33-b588afa78f61 tempest-VolumesActionsTest-807172941 None] Acquiring lock "cinder-d9a848f6-6bbe-4d8b-b676-ec9a053b329b-detach_volume" by "detach_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e2b0272b-225b-4206-8c33-b588afa78f61 tempest-VolumesActionsTest-807172941 None] Lock "cinder-d9a848f6-6bbe-4d8b-b676-ec9a053b329b-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:05 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-e2b0272b-225b-4206-8c33-b588afa78f61 tempest-VolumesActionsTest-807172941 None] Detaching volume d9a848f6-6bbe-4d8b-b676-ec9a053b329b from instance 29381003-ae01-4943-a5ff-ddd9db10aa1a. Sep 28 18:10:05 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-e2b0272b-225b-4206-8c33-b588afa78f61 tempest-VolumesActionsTest-807172941 None] Detach volume completed successfully. Sep 28 18:10:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e2b0272b-225b-4206-8c33-b588afa78f61 tempest-VolumesActionsTest-807172941 None] Lock "cinder-d9a848f6-6bbe-4d8b-b676-ec9a053b329b-detach_volume" released by "detach_volume" :: held 0.196s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-8c6bb87d-80c1-484d-a6a6-b5c8fc8b7079 tempest-VolumesActionsTest-1955705005 None] Acquiring lock "cinder-d9a848f6-6bbe-4d8b-b676-ec9a053b329b-detach_volume" by "detach_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-8c6bb87d-80c1-484d-a6a6-b5c8fc8b7079 tempest-VolumesActionsTest-1955705005 None] Lock "cinder-d9a848f6-6bbe-4d8b-b676-ec9a053b329b-detach_volume" acquired by "detach_volume" :: waited 0.105s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:06 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-8c6bb87d-80c1-484d-a6a6-b5c8fc8b7079 tempest-VolumesActionsTest-1955705005 None] Volume detach called, but volume not attached. Sep 28 18:10:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-8c6bb87d-80c1-484d-a6a6-b5c8fc8b7079 tempest-VolumesActionsTest-1955705005 None] Lock "cinder-d9a848f6-6bbe-4d8b-b676-ec9a053b329b-detach_volume" released by "detach_volume" :: held 0.056s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:07 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0b2df5ab-a4f6-4e3f-9c46-5795f52f3b96 tempest-VolumesActionsTest-1955705005 None] Acquiring lock "cinder-d9a848f6-6bbe-4d8b-b676-ec9a053b329b-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:07 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0b2df5ab-a4f6-4e3f-9c46-5795f52f3b96 tempest-VolumesActionsTest-1955705005 None] Lock "cinder-d9a848f6-6bbe-4d8b-b676-ec9a053b329b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:07 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0b2df5ab-a4f6-4e3f-9c46-5795f52f3b96 tempest-VolumesActionsTest-1955705005 None] Acquiring lock "cinder-quobyte-d9a848f6-6bbe-4d8b-b676-ec9a053b329b" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:07 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0b2df5ab-a4f6-4e3f-9c46-5795f52f3b96 tempest-VolumesActionsTest-1955705005 None] Lock "cinder-quobyte-d9a848f6-6bbe-4d8b-b676-ec9a053b329b" acquired by "delete_volume" :: waited 0.081s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:07 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[770327f3-feb9-4f6e-9784-b6b432ba1c16]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0b2df5ab-a4f6-4e3f-9c46-5795f52f3b96 tempest-VolumesActionsTest-1955705005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d9a848f6-6bbe-4d8b-b676-ec9a053b329b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:08 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d9a848f6-6bbe-4d8b-b676-ec9a053b329b Sep 28 18:10:08 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:08 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0b2df5ab-a4f6-4e3f-9c46-5795f52f3b96 tempest-VolumesActionsTest-1955705005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d9a848f6-6bbe-4d8b-b676-ec9a053b329b" returned: 0 in 1.080s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0b2df5ab-a4f6-4e3f-9c46-5795f52f3b96 tempest-VolumesActionsTest-1955705005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d9a848f6-6bbe-4d8b-b676-ec9a053b329b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:08 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d9a848f6-6bbe-4d8b-b676-ec9a053b329b Sep 28 18:10:08 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:09 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0b2df5ab-a4f6-4e3f-9c46-5795f52f3b96 tempest-VolumesActionsTest-1955705005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d9a848f6-6bbe-4d8b-b676-ec9a053b329b" returned: 0 in 0.507s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:09 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0b2df5ab-a4f6-4e3f-9c46-5795f52f3b96 tempest-VolumesActionsTest-1955705005 None] Lock "cinder-quobyte-d9a848f6-6bbe-4d8b-b676-ec9a053b329b" released by "delete_volume" :: held 1.753s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:09 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-0b2df5ab-a4f6-4e3f-9c46-5795f52f3b96 tempest-VolumesActionsTest-1955705005 None] Created reservations ['9fda475e-8645-4507-b728-1e01c05decb1', '1581da12-7902-4479-a96d-8edfe129e7dd', 'af45e0de-8134-4c05-9b6a-b656df2a1371', 'c77728e3-864e-4dfd-b695-40b596441368'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:10:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0b2df5ab-a4f6-4e3f-9c46-5795f52f3b96 tempest-VolumesActionsTest-1955705005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0b2df5ab-a4f6-4e3f-9c46-5795f52f3b96 tempest-VolumesActionsTest-1955705005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0b2df5ab-a4f6-4e3f-9c46-5795f52f3b96 tempest-VolumesActionsTest-1955705005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0b2df5ab-a4f6-4e3f-9c46-5795f52f3b96 tempest-VolumesActionsTest-1955705005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0b2df5ab-a4f6-4e3f-9c46-5795f52f3b96 tempest-VolumesActionsTest-1955705005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0b2df5ab-a4f6-4e3f-9c46-5795f52f3b96 tempest-VolumesActionsTest-1955705005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:09 devstack sudo[95701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:10:09 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:10 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0b2df5ab-a4f6-4e3f-9c46-5795f52f3b96 tempest-VolumesActionsTest-1955705005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.771s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:10 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-0b2df5ab-a4f6-4e3f-9c46-5795f52f3b96 tempest-VolumesActionsTest-1955705005 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:10:10 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-0b2df5ab-a4f6-4e3f-9c46-5795f52f3b96 tempest-VolumesActionsTest-1955705005 None] Deleted volume successfully. Sep 28 18:10:10 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0b2df5ab-a4f6-4e3f-9c46-5795f52f3b96 tempest-VolumesActionsTest-1955705005 None] Lock "cinder-d9a848f6-6bbe-4d8b-b676-ec9a053b329b-delete_volume" released by "delete_volume" :: held 3.192s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:10 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0c78cc51-ca0b-46d5-8763-a4ddef750bd8 tempest-VolumesActionsTest-530329014 None] Acquiring lock "cinder-215c48be-8f53-4662-af93-ef580b4c87e3" by "attach_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:10 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0c78cc51-ca0b-46d5-8763-a4ddef750bd8 tempest-VolumesActionsTest-530329014 None] Lock "cinder-215c48be-8f53-4662-af93-ef580b4c87e3" acquired by "attach_volume" :: waited 0.041s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:11 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-0c78cc51-ca0b-46d5-8763-a4ddef750bd8 tempest-VolumesActionsTest-530329014 None] Attaching volume 215c48be-8f53-4662-af93-ef580b4c87e3 to instance ea6856bc-eb17-4c1d-aad9-9575a7c1aaf6 at mountpoint /dev/vdb on host None. Sep 28 18:10:11 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-0c78cc51-ca0b-46d5-8763-a4ddef750bd8 tempest-VolumesActionsTest-530329014 None] Attach volume completed successfully. Sep 28 18:10:11 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0c78cc51-ca0b-46d5-8763-a4ddef750bd8 tempest-VolumesActionsTest-530329014 None] Lock "cinder-215c48be-8f53-4662-af93-ef580b4c87e3" released by "attach_volume" :: held 0.295s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:12 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f47146de-c99c-4ba5-94ad-1e5a8f9bd182 tempest-VolumesActionsTest-530329014 None] Acquiring lock "cinder-215c48be-8f53-4662-af93-ef580b4c87e3-detach_volume" by "detach_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:12 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f47146de-c99c-4ba5-94ad-1e5a8f9bd182 tempest-VolumesActionsTest-530329014 None] Lock "cinder-215c48be-8f53-4662-af93-ef580b4c87e3-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:12 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-f47146de-c99c-4ba5-94ad-1e5a8f9bd182 tempest-VolumesActionsTest-530329014 None] Detaching volume 215c48be-8f53-4662-af93-ef580b4c87e3 from instance ea6856bc-eb17-4c1d-aad9-9575a7c1aaf6. Sep 28 18:10:12 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-f47146de-c99c-4ba5-94ad-1e5a8f9bd182 tempest-VolumesActionsTest-530329014 None] Detach volume completed successfully. Sep 28 18:10:12 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f47146de-c99c-4ba5-94ad-1e5a8f9bd182 tempest-VolumesActionsTest-530329014 None] Lock "cinder-215c48be-8f53-4662-af93-ef580b4c87e3-detach_volume" released by "detach_volume" :: held 0.107s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:15 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:10:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Flow 'volume_create_manager' (27b53f15-a577-4d29-bf53-3e1817cf2de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89863f29-cb33-4011-a150-8c7f165861d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89863f29-cb33-4011-a150-8c7f165861d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-505031880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3a842a-24c0-48b7-91d2-0f57dfe4aa95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0747e3ae27144c098ba8696ad30b939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:16Z,use_quota=True,user_id='c382dfb8494c42978fbb04237342a584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d22dd15-bf2a-4fa3-811e-6608a6867021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d22dd15-bf2a-4fa3-811e-6608a6867021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f8c5531-5551-4d98-88e9-96db27e4eca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f8c5531-5551-4d98-88e9-96db27e4eca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa3a842a-24c0-48b7-91d2-0f57dfe4aa95', 'volume_name': 'volume-fa3a842a-24c0-48b7-91d2-0f57dfe4aa95', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e42ccae-77ec-4a2a-adfb-5c389c913054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e42ccae-77ec-4a2a-adfb-5c389c913054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24be2209-3c3a-401e-8cd7-1740608ef997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:15 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Volume fa3a842a-24c0-48b7-91d2-0f57dfe4aa95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa3a842a-24c0-48b7-91d2-0f57dfe4aa95', 'volume_size': 1} Sep 28 18:10:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:15 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-505031880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3a842a-24c0-48b7-91d2-0f57dfe4aa95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0747e3ae27144c098ba8696ad30b939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:16Z,use_quota=True,user_id='c382dfb8494c42978fbb04237342a584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:10:15 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Creating volume fa3a842a-24c0-48b7-91d2-0f57dfe4aa95 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:10:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:15 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:15 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:15 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:10:15 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:10:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa3a842a-24c0-48b7-91d2-0f57dfe4aa95 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:15 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa3a842a-24c0-48b7-91d2-0f57dfe4aa95 1073741824 Sep 28 18:10:15 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:16 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-6b17d839-2ace-4f99-966e-bc4148979db9 tempest-GroupsV320Test-623001791 None] Group tempest-GroupsV320Test-Group-1369419200: creating Sep 28 18:10:16 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-6b17d839-2ace-4f99-966e-bc4148979db9 tempest-GroupsV320Test-623001791 None] Group tempest-GroupsV320Test-Group-1369419200: created successfully Sep 28 18:10:16 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-6b17d839-2ace-4f99-966e-bc4148979db9 tempest-GroupsV320Test-623001791 None] Create group completed successfully. Sep 28 18:10:16 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa3a842a-24c0-48b7-91d2-0f57dfe4aa95 1073741824" returned: 0 in 0.644s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa3a842a-24c0-48b7-91d2-0f57dfe4aa95 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:16 devstack sudo[95764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa3a842a-24c0-48b7-91d2-0f57dfe4aa95 Sep 28 18:10:16 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:16 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa3a842a-24c0-48b7-91d2-0f57dfe4aa95" returned: 0 in 0.344s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:10:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24be2209-3c3a-401e-8cd7-1740608ef997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa3a842a-24c0-48b7-91d2-0f57dfe4aa95', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e027c6a-19dc-4cd8-8e21-2cf4e0dd4754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:16 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Volume volume-fa3a842a-24c0-48b7-91d2-0f57dfe4aa95 (fa3a842a-24c0-48b7-91d2-0f57dfe4aa95): created successfully Sep 28 18:10:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e027c6a-19dc-4cd8-8e21-2cf4e0dd4754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Flow 'volume_create_manager' (27b53f15-a577-4d29-bf53-3e1817cf2de7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:16 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-206bde3b-ed76-465f-a27b-99e05958c867 tempest-VolumesActionsTest-1955705005 None] Created volume successfully. Sep 28 18:10:18 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-9c5f37c7-2d60-449a-8d2a-be022026562c tempest-GroupsV320Test-623001791 None] Created reservations ['cfeecee1-2f80-4703-9290-f45a766e01d0'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:10:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c36a1813-2b19-488c-86d2-6f8f6743bed5 tempest-VolumesActionsTest-807172941 None] Acquiring lock "cinder-fa3a842a-24c0-48b7-91d2-0f57dfe4aa95-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c36a1813-2b19-488c-86d2-6f8f6743bed5 tempest-VolumesActionsTest-807172941 None] Lock "cinder-fa3a842a-24c0-48b7-91d2-0f57dfe4aa95-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-9c5f37c7-2d60-449a-8d2a-be022026562c tempest-GroupsV320Test-623001791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-9c5f37c7-2d60-449a-8d2a-be022026562c tempest-GroupsV320Test-623001791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-9c5f37c7-2d60-449a-8d2a-be022026562c tempest-GroupsV320Test-623001791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-9c5f37c7-2d60-449a-8d2a-be022026562c tempest-GroupsV320Test-623001791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-9c5f37c7-2d60-449a-8d2a-be022026562c tempest-GroupsV320Test-623001791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9c5f37c7-2d60-449a-8d2a-be022026562c tempest-GroupsV320Test-623001791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7f41830c-c26d-413a-ac6e-65963d14e062 tempest-VolumesActionsTest-530329014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7f41830c-c26d-413a-ac6e-65963d14e062 tempest-VolumesActionsTest-530329014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:18 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:10:18 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c36a1813-2b19-488c-86d2-6f8f6743bed5 tempest-VolumesActionsTest-807172941 None] Acquiring lock "cinder-quobyte-fa3a842a-24c0-48b7-91d2-0f57dfe4aa95" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c36a1813-2b19-488c-86d2-6f8f6743bed5 tempest-VolumesActionsTest-807172941 None] Lock "cinder-quobyte-fa3a842a-24c0-48b7-91d2-0f57dfe4aa95" acquired by "delete_volume" :: waited 0.023s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:18 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57bfa3c-e158-4a43-a144-fa10da2a1859]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7f41830c-c26d-413a-ac6e-65963d14e062 tempest-VolumesActionsTest-530329014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:18 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[446f880c-defb-4fa7-a642-1902b0f205a9]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c36a1813-2b19-488c-86d2-6f8f6743bed5 tempest-VolumesActionsTest-807172941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa3a842a-24c0-48b7-91d2-0f57dfe4aa95 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:18 devstack sudo[95779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3 Sep 28 18:10:18 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:18 devstack sudo[95780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa3a842a-24c0-48b7-91d2-0f57dfe4aa95 Sep 28 18:10:18 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:18 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9c5f37c7-2d60-449a-8d2a-be022026562c tempest-GroupsV320Test-623001791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.385s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:18 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-9c5f37c7-2d60-449a-8d2a-be022026562c tempest-GroupsV320Test-623001791 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:10:18 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-9c5f37c7-2d60-449a-8d2a-be022026562c tempest-GroupsV320Test-623001791 None] Delete group completed successfully. Sep 28 18:10:18 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7f41830c-c26d-413a-ac6e-65963d14e062 tempest-VolumesActionsTest-530329014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3" returned: 0 in 0.461s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:19 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[67594664-b134-4e65-80d7-85ecaa98f21d]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7f41830c-c26d-413a-ac6e-65963d14e062 tempest-VolumesActionsTest-530329014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:19 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c36a1813-2b19-488c-86d2-6f8f6743bed5 tempest-VolumesActionsTest-807172941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa3a842a-24c0-48b7-91d2-0f57dfe4aa95" returned: 0 in 0.504s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c36a1813-2b19-488c-86d2-6f8f6743bed5 tempest-VolumesActionsTest-807172941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa3a842a-24c0-48b7-91d2-0f57dfe4aa95 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:19 devstack sudo[95792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa3a842a-24c0-48b7-91d2-0f57dfe4aa95 Sep 28 18:10:19 devstack sudo[95792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:19 devstack sudo[95791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3 Sep 28 18:10:19 devstack sudo[95791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:19 devstack sudo[95792]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c36a1813-2b19-488c-86d2-6f8f6743bed5 tempest-VolumesActionsTest-807172941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa3a842a-24c0-48b7-91d2-0f57dfe4aa95" returned: 0 in 0.292s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:19 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c36a1813-2b19-488c-86d2-6f8f6743bed5 tempest-VolumesActionsTest-807172941 None] Lock "cinder-quobyte-fa3a842a-24c0-48b7-91d2-0f57dfe4aa95" released by "delete_volume" :: held 0.867s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:19 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-c36a1813-2b19-488c-86d2-6f8f6743bed5 tempest-VolumesActionsTest-807172941 None] Created reservations ['28ab06b6-3efa-41dd-b6f3-9600687ab46e', '84a86465-c24b-4230-8222-f54f56f84ac5', '1fb0e7bc-9fdf-48f1-9b2e-b01243f79183', 'dca53f35-b153-43b6-9743-1e0e476dfe36'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:10:19 devstack sudo[95791]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7f41830c-c26d-413a-ac6e-65963d14e062 tempest-VolumesActionsTest-530329014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3" returned: 0 in 0.481s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7f41830c-c26d-413a-ac6e-65963d14e062 tempest-VolumesActionsTest-530329014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3 /opt/stack/data/cinder/conversion/215c48be-8f53-4662-af93-ef580b4c87e3.temp_image.7ec7b022-8740-4c8c-a1d2-307438f26b6ei_toa7wv.img {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:19 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3 /opt/stack/data/cinder/conversion/215c48be-8f53-4662-af93-ef580b4c87e3.temp_image.7ec7b022-8740-4c8c-a1d2-307438f26b6ei_toa7wv.img Sep 28 18:10:19 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c36a1813-2b19-488c-86d2-6f8f6743bed5 tempest-VolumesActionsTest-807172941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c36a1813-2b19-488c-86d2-6f8f6743bed5 tempest-VolumesActionsTest-807172941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c36a1813-2b19-488c-86d2-6f8f6743bed5 tempest-VolumesActionsTest-807172941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c36a1813-2b19-488c-86d2-6f8f6743bed5 tempest-VolumesActionsTest-807172941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c36a1813-2b19-488c-86d2-6f8f6743bed5 tempest-VolumesActionsTest-807172941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c36a1813-2b19-488c-86d2-6f8f6743bed5 tempest-VolumesActionsTest-807172941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:19 devstack sudo[95801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:10:19 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:20 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c36a1813-2b19-488c-86d2-6f8f6743bed5 tempest-VolumesActionsTest-807172941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.512s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:20 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-c36a1813-2b19-488c-86d2-6f8f6743bed5 tempest-VolumesActionsTest-807172941 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:10:20 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-c36a1813-2b19-488c-86d2-6f8f6743bed5 tempest-VolumesActionsTest-807172941 None] Deleted volume successfully. Sep 28 18:10:20 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c36a1813-2b19-488c-86d2-6f8f6743bed5 tempest-VolumesActionsTest-807172941 None] Lock "cinder-fa3a842a-24c0-48b7-91d2-0f57dfe4aa95-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:20 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:10:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Flow 'volume_create_manager' (df6f04e0-4f15-48f9-85cc-b191a497614c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea3973af-f029-42dd-9cc6-c47bce302415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea3973af-f029-42dd-9cc6-c47bce302415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1450881312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=283c554e-b432-4d72-8d36-e967f4f28709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0747e3ae27144c098ba8696ad30b939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:20Z,use_quota=True,user_id='c382dfb8494c42978fbb04237342a584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd23f4b7-1e86-4aef-9571-b19a3975eb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd23f4b7-1e86-4aef-9571-b19a3975eb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60679a3d-201a-4046-a05b-aba98274ab05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60679a3d-201a-4046-a05b-aba98274ab05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '283c554e-b432-4d72-8d36-e967f4f28709', 'volume_name': 'volume-283c554e-b432-4d72-8d36-e967f4f28709', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5abef0fe-b65f-409c-849b-eebbe214f863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5abef0fe-b65f-409c-849b-eebbe214f863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e13ab9b9-a375-412e-94ed-305f9169baf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:20 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Volume 283c554e-b432-4d72-8d36-e967f4f28709: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-283c554e-b432-4d72-8d36-e967f4f28709', 'volume_size': 1} Sep 28 18:10:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:27 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7f41830c-c26d-413a-ac6e-65963d14e062 tempest-VolumesActionsTest-530329014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3 /opt/stack/data/cinder/conversion/215c48be-8f53-4662-af93-ef580b4c87e3.temp_image.7ec7b022-8740-4c8c-a1d2-307438f26b6ei_toa7wv.img" returned: 0 in 8.284s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:27 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[993889ab-0b03-4333-a114-c3ae55f618bd]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7f41830c-c26d-413a-ac6e-65963d14e062 tempest-VolumesActionsTest-530329014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:27 devstack sudo[95815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3 Sep 28 18:10:27 devstack sudo[95815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:28 devstack sudo[95815]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7f41830c-c26d-413a-ac6e-65963d14e062 tempest-VolumesActionsTest-530329014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3" returned: 0 in 0.596s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:28 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-7f41830c-c26d-413a-ac6e-65963d14e062 tempest-VolumesActionsTest-530329014 None] Image conversion details: src /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3, size 1024.00 MB, duration 8.28 sec, destination /opt/stack/data/cinder/conversion/215c48be-8f53-4662-af93-ef580b4c87e3.temp_image.7ec7b022-8740-4c8c-a1d2-307438f26b6ei_toa7wv.img {{(pid=86980) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:10:28 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-7f41830c-c26d-413a-ac6e-65963d14e062 tempest-VolumesActionsTest-530329014 None] Converted 1024.00 MB image at 123.60 MB/s Sep 28 18:10:28 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-7f41830c-c26d-413a-ac6e-65963d14e062 tempest-VolumesActionsTest-530329014 None] 7ec7b022-8740-4c8c-a1d2-307438f26b6e was raw, no need to convert to raw {{(pid=86980) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 18:10:30 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=51,cinder:INSERT=16,cinder:UPDATE=47,cinder:DELETE=2 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:10:33 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:10:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Flow 'volume_create_manager' (31775dab-c54e-454d-960e-9d57892082e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (995fa26c-4be5-449a-9631-d3bb7b559fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (995fa26c-4be5-449a-9631-d3bb7b559fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1927122894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ff0928-1dc8-4f2b-ad56-282d28925a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8cde73c375442b485d2f2567f3a5455',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:33Z,use_quota=True,user_id='cad5bfce6d314fd283f0680e1984230f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (503d5a9f-6292-4344-87d1-ad3ae498c607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (503d5a9f-6292-4344-87d1-ad3ae498c607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27cde3b2-38cd-4a21-b2c3-ec0976c4ca4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27cde3b2-38cd-4a21-b2c3-ec0976c4ca4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09ff0928-1dc8-4f2b-ad56-282d28925a6d', 'volume_name': 'volume-09ff0928-1dc8-4f2b-ad56-282d28925a6d', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89362271-221e-4bc6-a693-ca1a0ded3f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89362271-221e-4bc6-a693-ca1a0ded3f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1f13543-4a48-42b2-a259-ad5a81570325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:33 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Volume 09ff0928-1dc8-4f2b-ad56-282d28925a6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09ff0928-1dc8-4f2b-ad56-282d28925a6d', 'volume_size': 1} Sep 28 18:10:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:43 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=1 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:10:43 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=51,cinder:INSERT=8,cinder:UPDATE=53,cinder:DELETE=2 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:10:50 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:10:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Flow 'volume_create_manager' (e2391d43-a727-456b-89f2-a579b2d5e2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee045834-e36d-42bc-8073-ea531d97f11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee045834-e36d-42bc-8073-ea531d97f11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1885603448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0073a0-ec9a-485f-b284-54e20d34cd74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45624379d4d44c8398dcc48ae4c4c4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:50Z,use_quota=True,user_id='da985eff86264e9288fcd77709eed8c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53431c5d-ddb7-4d5d-8810-65220ff1e41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53431c5d-ddb7-4d5d-8810-65220ff1e41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63894ca1-9e61-468c-9a5b-b8dd162f39f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63894ca1-9e61-468c-9a5b-b8dd162f39f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a0073a0-ec9a-485f-b284-54e20d34cd74', 'volume_name': 'volume-8a0073a0-ec9a-485f-b284-54e20d34cd74', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636107ff-0942-40dc-9166-9afcf1074dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636107ff-0942-40dc-9166-9afcf1074dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa00ca9-0652-45b2-a17e-635afa988138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:50 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Volume 8a0073a0-ec9a-485f-b284-54e20d34cd74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a0073a0-ec9a-485f-b284-54e20d34cd74', 'volume_size': 1} Sep 28 18:10:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7f41830c-c26d-413a-ac6e-65963d14e062 tempest-VolumesActionsTest-530329014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.496s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7f41830c-c26d-413a-ac6e-65963d14e062 tempest-VolumesActionsTest-530329014 None] Uploaded volume to glance image-id: 7ec7b022-8740-4c8c-a1d2-307438f26b6e. {{(pid=86980) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 18:10:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 32.015s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:52 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1450881312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=283c554e-b432-4d72-8d36-e967f4f28709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0747e3ae27144c098ba8696ad30b939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:20Z,use_quota=True,user_id='c382dfb8494c42978fbb04237342a584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:10:52 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Creating volume 283c554e-b432-4d72-8d36-e967f4f28709 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:10:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:52 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:52 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:52 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:10:52 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:10:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-283c554e-b432-4d72-8d36-e967f4f28709 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:52 devstack sudo[95867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-283c554e-b432-4d72-8d36-e967f4f28709 1073741824 Sep 28 18:10:52 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:53 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-7f41830c-c26d-413a-ac6e-65963d14e062 tempest-VolumesActionsTest-530329014 None] Copy volume to image completed successfully. Sep 28 18:10:53 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-283c554e-b432-4d72-8d36-e967f4f28709 1073741824" returned: 0 in 0.580s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-283c554e-b432-4d72-8d36-e967f4f28709 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:53 devstack sudo[95873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-283c554e-b432-4d72-8d36-e967f4f28709 Sep 28 18:10:53 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:53 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-283c554e-b432-4d72-8d36-e967f4f28709" returned: 0 in 0.285s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:10:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.308s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1927122894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ff0928-1dc8-4f2b-ad56-282d28925a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8cde73c375442b485d2f2567f3a5455',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:33Z,use_quota=True,user_id='cad5bfce6d314fd283f0680e1984230f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:10:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Creating volume 09ff0928-1dc8-4f2b-ad56-282d28925a6d {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:10:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:10:53 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:10:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-09ff0928-1dc8-4f2b-ad56-282d28925a6d 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:53 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e13ab9b9-a375-412e-94ed-305f9169baf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-283c554e-b432-4d72-8d36-e967f4f28709', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:53 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dbd9295-b703-4d5f-8cbd-7bed47f2ebcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:53 devstack sudo[95876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-09ff0928-1dc8-4f2b-ad56-282d28925a6d 1073741824 Sep 28 18:10:53 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:53 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Volume volume-283c554e-b432-4d72-8d36-e967f4f28709 (283c554e-b432-4d72-8d36-e967f4f28709): created successfully Sep 28 18:10:53 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dbd9295-b703-4d5f-8cbd-7bed47f2ebcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:53 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Flow 'volume_create_manager' (df6f04e0-4f15-48f9-85cc-b191a497614c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:53 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-67cb400a-7e74-4e76-8be8-12a3329c292c tempest-VolumesActionsTest-1955705005 None] Created volume successfully. Sep 28 18:10:54 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-09ff0928-1dc8-4f2b-ad56-282d28925a6d 1073741824" returned: 0 in 0.586s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-09ff0928-1dc8-4f2b-ad56-282d28925a6d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-64876d3f-9e67-49e6-94b7-a95aa6c20559 tempest-VolumesActionsTest-530329014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:54 devstack sudo[95883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-09ff0928-1dc8-4f2b-ad56-282d28925a6d Sep 28 18:10:54 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:54 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-09ff0928-1dc8-4f2b-ad56-282d28925a6d" returned: 0 in 0.360s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:10:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.497s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1885603448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0073a0-ec9a-485f-b284-54e20d34cd74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45624379d4d44c8398dcc48ae4c4c4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:50Z,use_quota=True,user_id='da985eff86264e9288fcd77709eed8c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:10:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Creating volume 8a0073a0-ec9a-485f-b284-54e20d34cd74 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:10:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:10:54 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:10:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8a0073a0-ec9a-485f-b284-54e20d34cd74 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1f13543-4a48-42b2-a259-ad5a81570325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09ff0928-1dc8-4f2b-ad56-282d28925a6d', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:54 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8a0073a0-ec9a-485f-b284-54e20d34cd74 1073741824 Sep 28 18:10:54 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c2011ca-0bf3-4a38-90d7-98abf5b68451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:54 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Volume volume-09ff0928-1dc8-4f2b-ad56-282d28925a6d (09ff0928-1dc8-4f2b-ad56-282d28925a6d): created successfully Sep 28 18:10:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c2011ca-0bf3-4a38-90d7-98abf5b68451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Flow 'volume_create_manager' (31775dab-c54e-454d-960e-9d57892082e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:55 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-c1ab5b08-d9c4-4364-b2fa-413af3d29222 tempest-AttachVolumeShelveTestJSON-397274229 None] Created volume successfully. Sep 28 18:10:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-66fbc65b-2f4a-4585-9828-e028382ddecf tempest-VolumesActionsTest-807172941 None] Acquiring lock "cinder-283c554e-b432-4d72-8d36-e967f4f28709-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-66fbc65b-2f4a-4585-9828-e028382ddecf tempest-VolumesActionsTest-807172941 None] Lock "cinder-283c554e-b432-4d72-8d36-e967f4f28709-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-66fbc65b-2f4a-4585-9828-e028382ddecf tempest-VolumesActionsTest-807172941 None] Acquiring lock "cinder-quobyte-283c554e-b432-4d72-8d36-e967f4f28709" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-66fbc65b-2f4a-4585-9828-e028382ddecf tempest-VolumesActionsTest-807172941 None] Lock "cinder-quobyte-283c554e-b432-4d72-8d36-e967f4f28709" acquired by "delete_volume" :: waited 0.025s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:55 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c21658f-c465-4e7c-a924-14f1d5cfcfa5]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-66fbc65b-2f4a-4585-9828-e028382ddecf tempest-VolumesActionsTest-807172941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-283c554e-b432-4d72-8d36-e967f4f28709 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:55 devstack sudo[95890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-283c554e-b432-4d72-8d36-e967f4f28709 Sep 28 18:10:55 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:55 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8a0073a0-ec9a-485f-b284-54e20d34cd74 1073741824" returned: 0 in 0.668s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8a0073a0-ec9a-485f-b284-54e20d34cd74 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:55 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:55 devstack sudo[95901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8a0073a0-ec9a-485f-b284-54e20d34cd74 Sep 28 18:10:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-66fbc65b-2f4a-4585-9828-e028382ddecf tempest-VolumesActionsTest-807172941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-283c554e-b432-4d72-8d36-e967f4f28709" returned: 0 in 0.499s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:55 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-66fbc65b-2f4a-4585-9828-e028382ddecf tempest-VolumesActionsTest-807172941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-283c554e-b432-4d72-8d36-e967f4f28709 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:55 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-283c554e-b432-4d72-8d36-e967f4f28709 Sep 28 18:10:55 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:55 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8a0073a0-ec9a-485f-b284-54e20d34cd74" returned: 0 in 0.314s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:55 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:10:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-64876d3f-9e67-49e6-94b7-a95aa6c20559 tempest-VolumesActionsTest-530329014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.390s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa00ca9-0652-45b2-a17e-635afa988138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a0073a0-ec9a-485f-b284-54e20d34cd74', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e4becb6-9162-4942-9212-5252474ee324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:55 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f962db65-0dff-47b8-b68c-a5fcc59193bd]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-64876d3f-9e67-49e6-94b7-a95aa6c20559 tempest-VolumesActionsTest-530329014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:56 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Volume volume-8a0073a0-ec9a-485f-b284-54e20d34cd74 (8a0073a0-ec9a-485f-b284-54e20d34cd74): created successfully Sep 28 18:10:56 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e4becb6-9162-4942-9212-5252474ee324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Flow 'volume_create_manager' (e2391d43-a727-456b-89f2-a579b2d5e2b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-66fbc65b-2f4a-4585-9828-e028382ddecf tempest-VolumesActionsTest-807172941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-283c554e-b432-4d72-8d36-e967f4f28709" returned: 0 in 0.374s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:56 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-66fbc65b-2f4a-4585-9828-e028382ddecf tempest-VolumesActionsTest-807172941 None] Lock "cinder-quobyte-283c554e-b432-4d72-8d36-e967f4f28709" released by "delete_volume" :: held 0.955s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:56 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-c0344710-978e-42bb-afb4-3b413f4c84ea tempest-VolumeQuotasAdminTestJSON-494709641 None] Created volume successfully. Sep 28 18:10:56 devstack sudo[95907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3 Sep 28 18:10:56 devstack sudo[95907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:56 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-66fbc65b-2f4a-4585-9828-e028382ddecf tempest-VolumesActionsTest-807172941 None] Created reservations ['7acfc523-a09a-4733-85fb-c677bdd9678e', 'fee610a5-5e27-412a-8018-402cef844591', '5284ab74-70b3-436b-8691-62321170dbd9', 'bf9a16b4-43eb-4fe7-aca7-06588ef4ad82'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:10:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-66fbc65b-2f4a-4585-9828-e028382ddecf tempest-VolumesActionsTest-807172941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-66fbc65b-2f4a-4585-9828-e028382ddecf tempest-VolumesActionsTest-807172941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-66fbc65b-2f4a-4585-9828-e028382ddecf tempest-VolumesActionsTest-807172941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-66fbc65b-2f4a-4585-9828-e028382ddecf tempest-VolumesActionsTest-807172941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-66fbc65b-2f4a-4585-9828-e028382ddecf tempest-VolumesActionsTest-807172941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-66fbc65b-2f4a-4585-9828-e028382ddecf tempest-VolumesActionsTest-807172941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:56 devstack sudo[95909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:10:56 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:56 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-66fbc65b-2f4a-4585-9828-e028382ddecf tempest-VolumesActionsTest-807172941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.325s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:56 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-66fbc65b-2f4a-4585-9828-e028382ddecf tempest-VolumesActionsTest-807172941 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:10:56 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-66fbc65b-2f4a-4585-9828-e028382ddecf tempest-VolumesActionsTest-807172941 None] Deleted volume successfully. Sep 28 18:10:56 devstack sudo[95907]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-64876d3f-9e67-49e6-94b7-a95aa6c20559 tempest-VolumesActionsTest-530329014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3" returned: 0 in 0.700s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:56 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-66fbc65b-2f4a-4585-9828-e028382ddecf tempest-VolumesActionsTest-807172941 None] Lock "cinder-283c554e-b432-4d72-8d36-e967f4f28709-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:56 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b9489f-755f-418c-b232-a31564c664e1]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-64876d3f-9e67-49e6-94b7-a95aa6c20559 tempest-VolumesActionsTest-530329014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:56 devstack sudo[95915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3 Sep 28 18:10:56 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:56 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a3ee42f1-5126-463c-9f0d-d0395df208b2 tempest-VolumeQuotasAdminTestJSON-494709641 None] Acquiring lock "cinder-8a0073a0-ec9a-485f-b284-54e20d34cd74-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:57 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a3ee42f1-5126-463c-9f0d-d0395df208b2 tempest-VolumeQuotasAdminTestJSON-494709641 None] Lock "cinder-8a0073a0-ec9a-485f-b284-54e20d34cd74-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:57 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a3ee42f1-5126-463c-9f0d-d0395df208b2 tempest-VolumeQuotasAdminTestJSON-494709641 None] Acquiring lock "cinder-quobyte-8a0073a0-ec9a-485f-b284-54e20d34cd74" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:10:57 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a3ee42f1-5126-463c-9f0d-d0395df208b2 tempest-VolumeQuotasAdminTestJSON-494709641 None] Lock "cinder-quobyte-8a0073a0-ec9a-485f-b284-54e20d34cd74" acquired by "delete_volume" :: waited 0.036s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:10:57 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38b7e4b-276d-4331-b362-bbde36f38099]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:10:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a3ee42f1-5126-463c-9f0d-d0395df208b2 tempest-VolumeQuotasAdminTestJSON-494709641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8a0073a0-ec9a-485f-b284-54e20d34cd74 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:57 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:10:57 devstack sudo[95922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8a0073a0-ec9a-485f-b284-54e20d34cd74 Sep 28 18:10:57 devstack sudo[95922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Flow 'volume_create_manager' (ccc333c3-cac3-45b8-856e-242652bbe35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:10:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef83a67-f536-4d31-b66f-ddc52588715a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef83a67-f536-4d31-b66f-ddc52588715a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-386580526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a6eaee4-146a-44de-9ceb-c2330fb43cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0747e3ae27144c098ba8696ad30b939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:57Z,use_quota=True,user_id='c382dfb8494c42978fbb04237342a584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f628ee1-d584-4508-a540-387a8b38c6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f628ee1-d584-4508-a540-387a8b38c6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78efb48d-91ba-441c-9df2-513057d1f388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78efb48d-91ba-441c-9df2-513057d1f388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a6eaee4-146a-44de-9ceb-c2330fb43cf9', 'volume_name': 'volume-5a6eaee4-146a-44de-9ceb-c2330fb43cf9', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:57 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba5c83e-de6a-4ee0-b553-6c545a5573b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba5c83e-de6a-4ee0-b553-6c545a5573b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:10:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be33f69a-cce3-4b8e-b300-80573c581205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:10:57 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Volume 5a6eaee4-146a-44de-9ceb-c2330fb43cf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a6eaee4-146a-44de-9ceb-c2330fb43cf9', 'volume_size': 1} Sep 28 18:10:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-64876d3f-9e67-49e6-94b7-a95aa6c20559 tempest-VolumesActionsTest-530329014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3" returned: 0 in 0.802s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-64876d3f-9e67-49e6-94b7-a95aa6c20559 tempest-VolumesActionsTest-530329014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3 /opt/stack/data/cinder/conversion/215c48be-8f53-4662-af93-ef580b4c87e3.temp_image.e2dbd9dd-e6e1-4cbb-b78a-547908c0c72f1eh8xrqm.img {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:57 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3 /opt/stack/data/cinder/conversion/215c48be-8f53-4662-af93-ef580b4c87e3.temp_image.e2dbd9dd-e6e1-4cbb-b78a-547908c0c72f1eh8xrqm.img Sep 28 18:10:57 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:57 devstack sudo[95922]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a3ee42f1-5126-463c-9f0d-d0395df208b2 tempest-VolumeQuotasAdminTestJSON-494709641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8a0073a0-ec9a-485f-b284-54e20d34cd74" returned: 0 in 0.574s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a3ee42f1-5126-463c-9f0d-d0395df208b2 tempest-VolumeQuotasAdminTestJSON-494709641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8a0073a0-ec9a-485f-b284-54e20d34cd74 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:57 devstack sudo[95937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8a0073a0-ec9a-485f-b284-54e20d34cd74 Sep 28 18:10:57 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:58 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a3ee42f1-5126-463c-9f0d-d0395df208b2 tempest-VolumeQuotasAdminTestJSON-494709641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8a0073a0-ec9a-485f-b284-54e20d34cd74" returned: 0 in 0.372s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:58 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a3ee42f1-5126-463c-9f0d-d0395df208b2 tempest-VolumeQuotasAdminTestJSON-494709641 None] Lock "cinder-quobyte-8a0073a0-ec9a-485f-b284-54e20d34cd74" released by "delete_volume" :: held 1.053s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:10:58 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-a3ee42f1-5126-463c-9f0d-d0395df208b2 tempest-VolumeQuotasAdminTestJSON-494709641 None] Created reservations ['93e12c42-ba93-4486-8935-cbb97ec39bab', '3b552ffd-7ba4-4dac-9407-f6ddf0ca2367', '4eb90578-22d9-40ba-b6e0-8bf8b7daf7e7', '60934eea-ceeb-4b2d-b2a3-4551678130f3'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:10:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a3ee42f1-5126-463c-9f0d-d0395df208b2 tempest-VolumeQuotasAdminTestJSON-494709641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:10:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a3ee42f1-5126-463c-9f0d-d0395df208b2 tempest-VolumeQuotasAdminTestJSON-494709641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:10:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a3ee42f1-5126-463c-9f0d-d0395df208b2 tempest-VolumeQuotasAdminTestJSON-494709641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:10:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a3ee42f1-5126-463c-9f0d-d0395df208b2 tempest-VolumeQuotasAdminTestJSON-494709641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:10:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a3ee42f1-5126-463c-9f0d-d0395df208b2 tempest-VolumeQuotasAdminTestJSON-494709641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:10:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a3ee42f1-5126-463c-9f0d-d0395df208b2 tempest-VolumeQuotasAdminTestJSON-494709641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:10:58 devstack sudo[95956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:10:58 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:10:59 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root Sep 28 18:10:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a3ee42f1-5126-463c-9f0d-d0395df208b2 tempest-VolumeQuotasAdminTestJSON-494709641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.541s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:10:59 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-a3ee42f1-5126-463c-9f0d-d0395df208b2 tempest-VolumeQuotasAdminTestJSON-494709641 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:10:59 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-a3ee42f1-5126-463c-9f0d-d0395df208b2 tempest-VolumeQuotasAdminTestJSON-494709641 None] Deleted volume successfully. Sep 28 18:10:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a3ee42f1-5126-463c-9f0d-d0395df208b2 tempest-VolumeQuotasAdminTestJSON-494709641 None] Lock "cinder-8a0073a0-ec9a-485f-b284-54e20d34cd74-delete_volume" released by "delete_volume" :: held 2.173s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:00 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:11:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Flow 'volume_create_manager' (a24441e1-a191-40cf-9fac-f4554dd550cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396595d4-1d44-43df-a6f1-3ff6940fbfc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396595d4-1d44-43df-a6f1-3ff6940fbfc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1901995772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33c58545-5348-4e48-825c-0ac12b5aa377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45624379d4d44c8398dcc48ae4c4c4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:01Z,use_quota=True,user_id='da985eff86264e9288fcd77709eed8c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcbb8b1e-1035-47d2-9371-8ff5422f64d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcbb8b1e-1035-47d2-9371-8ff5422f64d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32a75ce-caa3-48a1-b7e0-a88e3fa4e1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32a75ce-caa3-48a1-b7e0-a88e3fa4e1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33c58545-5348-4e48-825c-0ac12b5aa377', 'volume_name': 'volume-33c58545-5348-4e48-825c-0ac12b5aa377', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (750c7eed-8eb5-48f7-a121-6da0c60e9952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (750c7eed-8eb5-48f7-a121-6da0c60e9952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423e704f-56dc-4e82-b4fc-19cafc8526e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:00 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Volume 33c58545-5348-4e48-825c-0ac12b5aa377: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33c58545-5348-4e48-825c-0ac12b5aa377', 'volume_size': 1} Sep 28 18:11:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:11:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:04 devstack sudo[95968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:11:04 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:05 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.530s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:05 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:11:05 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager._thread_info {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:11:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread count: 28 {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:11:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread info: [<_MainThread(MainThread, started 129097393381504)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:11:05 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-64876d3f-9e67-49e6-94b7-a95aa6c20559 tempest-VolumesActionsTest-530329014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3 /opt/stack/data/cinder/conversion/215c48be-8f53-4662-af93-ef580b4c87e3.temp_image.e2dbd9dd-e6e1-4cbb-b78a-547908c0c72f1eh8xrqm.img" returned: 0 in 7.923s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:05 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bde25bd-1758-42f7-8070-f400a77d93f9]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-64876d3f-9e67-49e6-94b7-a95aa6c20559 tempest-VolumesActionsTest-530329014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:05 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3 Sep 28 18:11:05 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:06 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-64876d3f-9e67-49e6-94b7-a95aa6c20559 tempest-VolumesActionsTest-530329014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3" returned: 0 in 0.597s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:06 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-64876d3f-9e67-49e6-94b7-a95aa6c20559 tempest-VolumesActionsTest-530329014 None] Image conversion details: src /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3, size 1024.00 MB, duration 7.92 sec, destination /opt/stack/data/cinder/conversion/215c48be-8f53-4662-af93-ef580b4c87e3.temp_image.e2dbd9dd-e6e1-4cbb-b78a-547908c0c72f1eh8xrqm.img {{(pid=86980) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:11:06 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-64876d3f-9e67-49e6-94b7-a95aa6c20559 tempest-VolumesActionsTest-530329014 None] Converted 1024.00 MB image at 129.23 MB/s Sep 28 18:11:06 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-64876d3f-9e67-49e6-94b7-a95aa6c20559 tempest-VolumesActionsTest-530329014 None] e2dbd9dd-e6e1-4cbb-b78a-547908c0c72f was raw, converting to qcow2 {{(pid=86980) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 28 18:11:06 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e8471d-4345-4288-8774-39bd1d43dc5c]: (4, 'raw') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-64876d3f-9e67-49e6-94b7-a95aa6c20559 tempest-VolumesActionsTest-530329014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/215c48be-8f53-4662-af93-ef580b4c87e3.temp_image.e2dbd9dd-e6e1-4cbb-b78a-547908c0c72f1eh8xrqm.img {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:06 devstack sudo[95977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/215c48be-8f53-4662-af93-ef580b4c87e3.temp_image.e2dbd9dd-e6e1-4cbb-b78a-547908c0c72f1eh8xrqm.img Sep 28 18:11:06 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:06 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-64876d3f-9e67-49e6-94b7-a95aa6c20559 tempest-VolumesActionsTest-530329014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/215c48be-8f53-4662-af93-ef580b4c87e3.temp_image.e2dbd9dd-e6e1-4cbb-b78a-547908c0c72f1eh8xrqm.img" returned: 0 in 0.429s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-64876d3f-9e67-49e6-94b7-a95aa6c20559 tempest-VolumesActionsTest-530329014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/215c48be-8f53-4662-af93-ef580b4c87e3.temp_image.e2dbd9dd-e6e1-4cbb-b78a-547908c0c72f1eh8xrqm.img {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:06 devstack sudo[95990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/215c48be-8f53-4662-af93-ef580b4c87e3.temp_image.e2dbd9dd-e6e1-4cbb-b78a-547908c0c72f1eh8xrqm.img Sep 28 18:11:06 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:07 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-64876d3f-9e67-49e6-94b7-a95aa6c20559 tempest-VolumesActionsTest-530329014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/215c48be-8f53-4662-af93-ef580b4c87e3.temp_image.e2dbd9dd-e6e1-4cbb-b78a-547908c0c72f1eh8xrqm.img" returned: 1 in 0.469s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-64876d3f-9e67-49e6-94b7-a95aa6c20559 tempest-VolumesActionsTest-530329014 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/215c48be-8f53-4662-af93-ef580b4c87e3.temp_image.e2dbd9dd-e6e1-4cbb-b78a-547908c0c72f1eh8xrqm.img' failed. Not Retrying. {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:11:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-64876d3f-9e67-49e6-94b7-a95aa6c20559 tempest-VolumesActionsTest-530329014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/215c48be-8f53-4662-af93-ef580b4c87e3.temp_image.e2dbd9dd-e6e1-4cbb-b78a-547908c0c72f1eh8xrqm.img /opt/stack/data/cinder/conversion/vol_upload_4a524sd_ {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:07 devstack sudo[96004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/215c48be-8f53-4662-af93-ef580b4c87e3.temp_image.e2dbd9dd-e6e1-4cbb-b78a-547908c0c72f1eh8xrqm.img /opt/stack/data/cinder/conversion/vol_upload_4a524sd_ Sep 28 18:11:07 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:07 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-64876d3f-9e67-49e6-94b7-a95aa6c20559 tempest-VolumesActionsTest-530329014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/215c48be-8f53-4662-af93-ef580b4c87e3.temp_image.e2dbd9dd-e6e1-4cbb-b78a-547908c0c72f1eh8xrqm.img /opt/stack/data/cinder/conversion/vol_upload_4a524sd_" returned: 0 in 0.338s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:07 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-64876d3f-9e67-49e6-94b7-a95aa6c20559 tempest-VolumesActionsTest-530329014 None] Image conversion details: src /opt/stack/data/cinder/conversion/215c48be-8f53-4662-af93-ef580b4c87e3.temp_image.e2dbd9dd-e6e1-4cbb-b78a-547908c0c72f1eh8xrqm.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_4a524sd_ {{(pid=86980) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:11:07 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-64876d3f-9e67-49e6-94b7-a95aa6c20559 tempest-VolumesActionsTest-530329014 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 28 18:11:07 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca43662-ad15-47a8-9354-0dae5dc2f478]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-64876d3f-9e67-49e6-94b7-a95aa6c20559 tempest-VolumesActionsTest-530329014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4a524sd_ {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:07 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4a524sd_ Sep 28 18:11:07 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:07 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-64876d3f-9e67-49e6-94b7-a95aa6c20559 tempest-VolumesActionsTest-530329014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4a524sd_" returned: 0 in 0.371s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-371e45b1-7256-4d8a-81ef-f974105e5074 req-04ab7eea-7f67-4ae1-903e-a605744dd9b2 tempest-AttachVolumeShelveTestJSON-397274229 None] No connector for attachment 96a3fedf-82ce-4cbf-96b1-dbbb0d6cf511; skipping storage backend terminate_connection call. {{(pid=86980) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 28 18:11:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-371e45b1-7256-4d8a-81ef-f974105e5074 req-04ab7eea-7f67-4ae1-903e-a605744dd9b2 tempest-AttachVolumeShelveTestJSON-397274229 None] Deleting attachment 96a3fedf-82ce-4cbf-96b1-dbbb0d6cf511. {{(pid=86980) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:11:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-64876d3f-9e67-49e6-94b7-a95aa6c20559 tempest-VolumesActionsTest-530329014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.589s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-64876d3f-9e67-49e6-94b7-a95aa6c20559 tempest-VolumesActionsTest-530329014 None] Uploaded volume to glance image-id: e2dbd9dd-e6e1-4cbb-b78a-547908c0c72f. {{(pid=86980) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 18:11:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.031s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-386580526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a6eaee4-146a-44de-9ceb-c2330fb43cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0747e3ae27144c098ba8696ad30b939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:10:57Z,use_quota=True,user_id='c382dfb8494c42978fbb04237342a584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:11:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Creating volume 5a6eaee4-146a-44de-9ceb-c2330fb43cf9 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:11:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:11:09 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:11:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a6eaee4-146a-44de-9ceb-c2330fb43cf9 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:09 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a6eaee4-146a-44de-9ceb-c2330fb43cf9 1073741824 Sep 28 18:11:09 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:09 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-64876d3f-9e67-49e6-94b7-a95aa6c20559 tempest-VolumesActionsTest-530329014 None] Copy volume to image completed successfully. Sep 28 18:11:10 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a6eaee4-146a-44de-9ceb-c2330fb43cf9 1073741824" returned: 0 in 0.513s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a6eaee4-146a-44de-9ceb-c2330fb43cf9 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:10 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a6eaee4-146a-44de-9ceb-c2330fb43cf9 Sep 28 18:11:10 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:10 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a6eaee4-146a-44de-9ceb-c2330fb43cf9" returned: 0 in 0.319s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:10 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:11:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.546s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:10 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1901995772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33c58545-5348-4e48-825c-0ac12b5aa377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45624379d4d44c8398dcc48ae4c4c4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:01Z,use_quota=True,user_id='da985eff86264e9288fcd77709eed8c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:11:10 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Creating volume 33c58545-5348-4e48-825c-0ac12b5aa377 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:11:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:10 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:10 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:10 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:11:10 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:11:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-33c58545-5348-4e48-825c-0ac12b5aa377 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:10 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be33f69a-cce3-4b8e-b300-80573c581205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a6eaee4-146a-44de-9ceb-c2330fb43cf9', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:10 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c0e2c7-37ae-4ca0-89c6-d6bf088f2295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:10 devstack sudo[96031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-33c58545-5348-4e48-825c-0ac12b5aa377 1073741824 Sep 28 18:11:10 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:10 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Volume volume-5a6eaee4-146a-44de-9ceb-c2330fb43cf9 (5a6eaee4-146a-44de-9ceb-c2330fb43cf9): created successfully Sep 28 18:11:10 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c0e2c7-37ae-4ca0-89c6-d6bf088f2295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:10 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Flow 'volume_create_manager' (ccc333c3-cac3-45b8-856e-242652bbe35b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:10 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-54784a8f-8a14-4f14-a695-cbea56509364 tempest-VolumesActionsTest-1955705005 None] Created volume successfully. Sep 28 18:11:10 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bc9b6888-1ccf-42a5-9b7e-b4b6ff4e61bd tempest-VolumesActionsTest-807172941 None] Acquiring lock "cinder-5a6eaee4-146a-44de-9ceb-c2330fb43cf9-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:10 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bc9b6888-1ccf-42a5-9b7e-b4b6ff4e61bd tempest-VolumesActionsTest-807172941 None] Lock "cinder-5a6eaee4-146a-44de-9ceb-c2330fb43cf9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:10 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bc9b6888-1ccf-42a5-9b7e-b4b6ff4e61bd tempest-VolumesActionsTest-807172941 None] Acquiring lock "cinder-quobyte-5a6eaee4-146a-44de-9ceb-c2330fb43cf9" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:10 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bc9b6888-1ccf-42a5-9b7e-b4b6ff4e61bd tempest-VolumesActionsTest-807172941 None] Lock "cinder-quobyte-5a6eaee4-146a-44de-9ceb-c2330fb43cf9" acquired by "delete_volume" :: waited 0.025s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:11 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdf6c3b-4048-4ac6-acdb-346e295509f7]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bc9b6888-1ccf-42a5-9b7e-b4b6ff4e61bd tempest-VolumesActionsTest-807172941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a6eaee4-146a-44de-9ceb-c2330fb43cf9 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:11 devstack sudo[96037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a6eaee4-146a-44de-9ceb-c2330fb43cf9 Sep 28 18:11:11 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:11 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-33c58545-5348-4e48-825c-0ac12b5aa377 1073741824" returned: 0 in 0.743s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-33c58545-5348-4e48-825c-0ac12b5aa377 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:11 devstack sudo[96040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-33c58545-5348-4e48-825c-0ac12b5aa377 Sep 28 18:11:11 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:11 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-371b17b6-af20-4530-b121-a0ea025acb9b tempest-VolumesActionsTest-530329014 None] Acquiring lock "cinder-215c48be-8f53-4662-af93-ef580b4c87e3-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:11 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-371b17b6-af20-4530-b121-a0ea025acb9b tempest-VolumesActionsTest-530329014 None] Lock "cinder-215c48be-8f53-4662-af93-ef580b4c87e3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:11 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-371b17b6-af20-4530-b121-a0ea025acb9b tempest-VolumesActionsTest-530329014 None] Acquiring lock "cinder-quobyte-215c48be-8f53-4662-af93-ef580b4c87e3" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:11 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-371b17b6-af20-4530-b121-a0ea025acb9b tempest-VolumesActionsTest-530329014 None] Lock "cinder-quobyte-215c48be-8f53-4662-af93-ef580b4c87e3" acquired by "delete_volume" :: waited 0.025s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:11 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc16b1f4-e7ab-4d71-8cc3-bc94b7706b4e]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-371b17b6-af20-4530-b121-a0ea025acb9b tempest-VolumesActionsTest-530329014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:11 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-33c58545-5348-4e48-825c-0ac12b5aa377" returned: 0 in 0.437s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:11 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:11:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:11 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3 Sep 28 18:11:11 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:11 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:11 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423e704f-56dc-4e82-b4fc-19cafc8526e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33c58545-5348-4e48-825c-0ac12b5aa377', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:11 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0517559d-8fa7-4960-9e7e-dd79aa3a4054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bc9b6888-1ccf-42a5-9b7e-b4b6ff4e61bd tempest-VolumesActionsTest-807172941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a6eaee4-146a-44de-9ceb-c2330fb43cf9" returned: 0 in 0.760s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bc9b6888-1ccf-42a5-9b7e-b4b6ff4e61bd tempest-VolumesActionsTest-807172941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a6eaee4-146a-44de-9ceb-c2330fb43cf9 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:11 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Volume volume-33c58545-5348-4e48-825c-0ac12b5aa377 (33c58545-5348-4e48-825c-0ac12b5aa377): created successfully Sep 28 18:11:11 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0517559d-8fa7-4960-9e7e-dd79aa3a4054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:11 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Flow 'volume_create_manager' (a24441e1-a191-40cf-9fac-f4554dd550cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:11 devstack sudo[96049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a6eaee4-146a-44de-9ceb-c2330fb43cf9 Sep 28 18:11:11 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:11 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-9cb1cb56-2ae0-4c78-8bc2-8106e119e690 tempest-VolumeQuotasAdminTestJSON-494709641 None] Created volume successfully. Sep 28 18:11:12 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-371b17b6-af20-4530-b121-a0ea025acb9b tempest-VolumesActionsTest-530329014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3" returned: 0 in 0.491s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-371b17b6-af20-4530-b121-a0ea025acb9b tempest-VolumesActionsTest-530329014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:12 devstack sudo[96055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3 Sep 28 18:11:12 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:12 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bc9b6888-1ccf-42a5-9b7e-b4b6ff4e61bd tempest-VolumesActionsTest-807172941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a6eaee4-146a-44de-9ceb-c2330fb43cf9" returned: 0 in 0.360s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:12 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bc9b6888-1ccf-42a5-9b7e-b4b6ff4e61bd tempest-VolumesActionsTest-807172941 None] Lock "cinder-quobyte-5a6eaee4-146a-44de-9ceb-c2330fb43cf9" released by "delete_volume" :: held 1.199s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:12 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-bc9b6888-1ccf-42a5-9b7e-b4b6ff4e61bd tempest-VolumesActionsTest-807172941 None] Created reservations ['bbb7e448-9dda-48c9-84d4-13f1803ef536', '556786c5-f8e9-4293-936c-75b1a8096a02', 'f15968fa-40fc-49a0-a358-aa66722934f3', '381ca9d5-9727-4e52-ba62-aa55d78d85e8'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:11:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bc9b6888-1ccf-42a5-9b7e-b4b6ff4e61bd tempest-VolumesActionsTest-807172941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bc9b6888-1ccf-42a5-9b7e-b4b6ff4e61bd tempest-VolumesActionsTest-807172941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:12 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-bc9b6888-1ccf-42a5-9b7e-b4b6ff4e61bd tempest-VolumesActionsTest-807172941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:12 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-bc9b6888-1ccf-42a5-9b7e-b4b6ff4e61bd tempest-VolumesActionsTest-807172941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bc9b6888-1ccf-42a5-9b7e-b4b6ff4e61bd tempest-VolumesActionsTest-807172941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bc9b6888-1ccf-42a5-9b7e-b4b6ff4e61bd tempest-VolumesActionsTest-807172941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:12 devstack sudo[96057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:11:12 devstack sudo[96057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:12 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-371b17b6-af20-4530-b121-a0ea025acb9b tempest-VolumesActionsTest-530329014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215c48be-8f53-4662-af93-ef580b4c87e3" returned: 0 in 0.344s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:12 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-371b17b6-af20-4530-b121-a0ea025acb9b tempest-VolumesActionsTest-530329014 None] Lock "cinder-quobyte-215c48be-8f53-4662-af93-ef580b4c87e3" released by "delete_volume" :: held 0.903s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:12 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-371b17b6-af20-4530-b121-a0ea025acb9b tempest-VolumesActionsTest-530329014 None] Created reservations ['82964fd0-875e-47d9-973d-0d6edeefa7a4', 'd32743ec-5059-4afc-bc75-6905fc686be5', 'bda94a59-1e13-4ebd-93ae-581d92af374a', '91f332b7-bc10-4ddf-995f-8a9c6923eeb3'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:11:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-371b17b6-af20-4530-b121-a0ea025acb9b tempest-VolumesActionsTest-530329014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-371b17b6-af20-4530-b121-a0ea025acb9b tempest-VolumesActionsTest-530329014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:12 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-371b17b6-af20-4530-b121-a0ea025acb9b tempest-VolumesActionsTest-530329014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:12 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-371b17b6-af20-4530-b121-a0ea025acb9b tempest-VolumesActionsTest-530329014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-371b17b6-af20-4530-b121-a0ea025acb9b tempest-VolumesActionsTest-530329014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-371b17b6-af20-4530-b121-a0ea025acb9b tempest-VolumesActionsTest-530329014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:12 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:11:12 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:12 devstack sudo[96057]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bc9b6888-1ccf-42a5-9b7e-b4b6ff4e61bd tempest-VolumesActionsTest-807172941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.372s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:12 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-bc9b6888-1ccf-42a5-9b7e-b4b6ff4e61bd tempest-VolumesActionsTest-807172941 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:11:12 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-bc9b6888-1ccf-42a5-9b7e-b4b6ff4e61bd tempest-VolumesActionsTest-807172941 None] Deleted volume successfully. Sep 28 18:11:12 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bc9b6888-1ccf-42a5-9b7e-b4b6ff4e61bd tempest-VolumesActionsTest-807172941 None] Lock "cinder-5a6eaee4-146a-44de-9ceb-c2330fb43cf9-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:13 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-371b17b6-af20-4530-b121-a0ea025acb9b tempest-VolumesActionsTest-530329014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.434s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:13 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-371b17b6-af20-4530-b121-a0ea025acb9b tempest-VolumesActionsTest-530329014 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:11:13 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-371b17b6-af20-4530-b121-a0ea025acb9b tempest-VolumesActionsTest-530329014 None] Deleted volume successfully. Sep 28 18:11:13 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-371b17b6-af20-4530-b121-a0ea025acb9b tempest-VolumesActionsTest-530329014 None] Lock "cinder-215c48be-8f53-4662-af93-ef580b4c87e3-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:14 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:11:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Flow 'volume_create_manager' (e36536e1-e91e-4a22-820f-2505124a6e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589f2d11-37eb-4e5f-900a-0f4dde2a584c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:14 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-101fa189-224b-4550-b1d0-7e5bd8f62e42 tempest-VolumeQuotasAdminTestJSON-477575778 None] Transfer volume completed successfully. Sep 28 18:11:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589f2d11-37eb-4e5f-900a-0f4dde2a584c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1025693342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76206a76-e602-4666-90eb-971e1cf1807a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0747e3ae27144c098ba8696ad30b939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:14Z,use_quota=True,user_id='c382dfb8494c42978fbb04237342a584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b9c99e-b234-44ec-800a-86c3c1dfe68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b9c99e-b234-44ec-800a-86c3c1dfe68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cdbf51f-c409-4e46-8128-738f2a10c413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cdbf51f-c409-4e46-8128-738f2a10c413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76206a76-e602-4666-90eb-971e1cf1807a', 'volume_name': 'volume-76206a76-e602-4666-90eb-971e1cf1807a', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e14c67-045a-4e3f-91ac-57c11f01f2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e14c67-045a-4e3f-91ac-57c11f01f2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e50443-c2e1-4d48-b6ad-31bfcd18642f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:14 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Volume 76206a76-e602-4666-90eb-971e1cf1807a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76206a76-e602-4666-90eb-971e1cf1807a', 'volume_size': 1} Sep 28 18:11:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:14 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1025693342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76206a76-e602-4666-90eb-971e1cf1807a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0747e3ae27144c098ba8696ad30b939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:14Z,use_quota=True,user_id='c382dfb8494c42978fbb04237342a584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:11:14 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Creating volume 76206a76-e602-4666-90eb-971e1cf1807a {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:11:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:14 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:14 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:14 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:11:14 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:11:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-76206a76-e602-4666-90eb-971e1cf1807a 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:14 devstack sudo[96065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-76206a76-e602-4666-90eb-971e1cf1807a 1073741824 Sep 28 18:11:14 devstack sudo[96065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:14 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c01b0091-9f7e-4ea2-b363-70245be074ef tempest-VolumeQuotasAdminTestJSON-1918798106 None] Acquiring lock "cinder-33c58545-5348-4e48-825c-0ac12b5aa377-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:14 devstack sudo[96065]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:15 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c01b0091-9f7e-4ea2-b363-70245be074ef tempest-VolumeQuotasAdminTestJSON-1918798106 None] Lock "cinder-33c58545-5348-4e48-825c-0ac12b5aa377-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-76206a76-e602-4666-90eb-971e1cf1807a 1073741824" returned: 0 in 0.698s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-76206a76-e602-4666-90eb-971e1cf1807a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:15 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c01b0091-9f7e-4ea2-b363-70245be074ef tempest-VolumeQuotasAdminTestJSON-1918798106 None] Acquiring lock "cinder-quobyte-33c58545-5348-4e48-825c-0ac12b5aa377" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:15 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-76206a76-e602-4666-90eb-971e1cf1807a Sep 28 18:11:15 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:15 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c01b0091-9f7e-4ea2-b363-70245be074ef tempest-VolumeQuotasAdminTestJSON-1918798106 None] Lock "cinder-quobyte-33c58545-5348-4e48-825c-0ac12b5aa377" acquired by "delete_volume" :: waited 0.054s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:15 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8265f043-75f6-42e9-a5cd-2dec01f966f2]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c01b0091-9f7e-4ea2-b363-70245be074ef tempest-VolumeQuotasAdminTestJSON-1918798106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-33c58545-5348-4e48-825c-0ac12b5aa377 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:15 devstack sudo[96072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-33c58545-5348-4e48-825c-0ac12b5aa377 Sep 28 18:11:15 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:15 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-76206a76-e602-4666-90eb-971e1cf1807a" returned: 0 in 0.607s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:15 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:11:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e50443-c2e1-4d48-b6ad-31bfcd18642f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76206a76-e602-4666-90eb-971e1cf1807a', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f2eeb2-d2dc-4b64-bcaf-73c8d975ac5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:15 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Volume volume-76206a76-e602-4666-90eb-971e1cf1807a (76206a76-e602-4666-90eb-971e1cf1807a): created successfully Sep 28 18:11:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f2eeb2-d2dc-4b64-bcaf-73c8d975ac5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Flow 'volume_create_manager' (e36536e1-e91e-4a22-820f-2505124a6e83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:15 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-29ea3620-d0f5-4ada-b83f-50a13750eb7c tempest-VolumesActionsTest-1955705005 None] Created volume successfully. Sep 28 18:11:16 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c01b0091-9f7e-4ea2-b363-70245be074ef tempest-VolumeQuotasAdminTestJSON-1918798106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-33c58545-5348-4e48-825c-0ac12b5aa377" returned: 0 in 0.826s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c01b0091-9f7e-4ea2-b363-70245be074ef tempest-VolumeQuotasAdminTestJSON-1918798106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-33c58545-5348-4e48-825c-0ac12b5aa377 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:16 devstack sudo[96081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-33c58545-5348-4e48-825c-0ac12b5aa377 Sep 28 18:11:16 devstack sudo[96081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:16 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-42d28133-4b3c-471b-a16f-f3001005ad70 tempest-VolumesActionsTest-807172941 None] Acquiring lock "cinder-76206a76-e602-4666-90eb-971e1cf1807a-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:16 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-42d28133-4b3c-471b-a16f-f3001005ad70 tempest-VolumesActionsTest-807172941 None] Lock "cinder-76206a76-e602-4666-90eb-971e1cf1807a-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:16 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-42d28133-4b3c-471b-a16f-f3001005ad70 tempest-VolumesActionsTest-807172941 None] Acquiring lock "cinder-quobyte-76206a76-e602-4666-90eb-971e1cf1807a" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:16 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-42d28133-4b3c-471b-a16f-f3001005ad70 tempest-VolumesActionsTest-807172941 None] Lock "cinder-quobyte-76206a76-e602-4666-90eb-971e1cf1807a" acquired by "delete_volume" :: waited 0.031s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:16 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4205e72d-0580-4f13-9a14-adc725e98f50]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-42d28133-4b3c-471b-a16f-f3001005ad70 tempest-VolumesActionsTest-807172941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-76206a76-e602-4666-90eb-971e1cf1807a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:16 devstack sudo[96081]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c01b0091-9f7e-4ea2-b363-70245be074ef tempest-VolumeQuotasAdminTestJSON-1918798106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-33c58545-5348-4e48-825c-0ac12b5aa377" returned: 0 in 0.697s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:16 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c01b0091-9f7e-4ea2-b363-70245be074ef tempest-VolumeQuotasAdminTestJSON-1918798106 None] Lock "cinder-quobyte-33c58545-5348-4e48-825c-0ac12b5aa377" released by "delete_volume" :: held 1.612s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:16 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-c01b0091-9f7e-4ea2-b363-70245be074ef tempest-VolumeQuotasAdminTestJSON-1918798106 None] Created reservations ['5c631a54-78ab-4e78-93a3-e2da50b09242', '0b1edd56-5637-41d1-a557-fdca6ee24238', 'a6ef2400-ac56-4a8d-8add-d0ad823432d3', '72284219-0da4-4e88-a075-a375cf005fe3'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:11:16 devstack sudo[96084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-76206a76-e602-4666-90eb-971e1cf1807a Sep 28 18:11:16 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c01b0091-9f7e-4ea2-b363-70245be074ef tempest-VolumeQuotasAdminTestJSON-1918798106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c01b0091-9f7e-4ea2-b363-70245be074ef tempest-VolumeQuotasAdminTestJSON-1918798106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c01b0091-9f7e-4ea2-b363-70245be074ef tempest-VolumeQuotasAdminTestJSON-1918798106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:17 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c01b0091-9f7e-4ea2-b363-70245be074ef tempest-VolumeQuotasAdminTestJSON-1918798106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c01b0091-9f7e-4ea2-b363-70245be074ef tempest-VolumeQuotasAdminTestJSON-1918798106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c01b0091-9f7e-4ea2-b363-70245be074ef tempest-VolumeQuotasAdminTestJSON-1918798106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:17 devstack sudo[96086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:11:17 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:17 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-42d28133-4b3c-471b-a16f-f3001005ad70 tempest-VolumesActionsTest-807172941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-76206a76-e602-4666-90eb-971e1cf1807a" returned: 0 in 0.704s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-42d28133-4b3c-471b-a16f-f3001005ad70 tempest-VolumesActionsTest-807172941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-76206a76-e602-4666-90eb-971e1cf1807a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:17 devstack sudo[96092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-76206a76-e602-4666-90eb-971e1cf1807a Sep 28 18:11:17 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:17 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c01b0091-9f7e-4ea2-b363-70245be074ef tempest-VolumeQuotasAdminTestJSON-1918798106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.590s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:17 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-c01b0091-9f7e-4ea2-b363-70245be074ef tempest-VolumeQuotasAdminTestJSON-1918798106 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:11:17 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-c01b0091-9f7e-4ea2-b363-70245be074ef tempest-VolumeQuotasAdminTestJSON-1918798106 None] Deleted volume successfully. Sep 28 18:11:17 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c01b0091-9f7e-4ea2-b363-70245be074ef tempest-VolumeQuotasAdminTestJSON-1918798106 None] Lock "cinder-33c58545-5348-4e48-825c-0ac12b5aa377-delete_volume" released by "delete_volume" :: held 2.639s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:17 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-42d28133-4b3c-471b-a16f-f3001005ad70 tempest-VolumesActionsTest-807172941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-76206a76-e602-4666-90eb-971e1cf1807a" returned: 0 in 0.576s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-42d28133-4b3c-471b-a16f-f3001005ad70 tempest-VolumesActionsTest-807172941 None] Lock "cinder-quobyte-76206a76-e602-4666-90eb-971e1cf1807a" released by "delete_volume" :: held 1.355s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:18 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-42d28133-4b3c-471b-a16f-f3001005ad70 tempest-VolumesActionsTest-807172941 None] Created reservations ['f80186d4-a5ed-4304-8de0-9ba03fd66818', '313d0dda-d1f6-4086-8d25-c005163fa6b9', '24af65e1-fdd0-411b-8552-269290df24bf', 'bf1e3fd5-01ef-4dc0-baeb-cb38cbfb1417'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:11:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-42d28133-4b3c-471b-a16f-f3001005ad70 tempest-VolumesActionsTest-807172941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-42d28133-4b3c-471b-a16f-f3001005ad70 tempest-VolumesActionsTest-807172941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-42d28133-4b3c-471b-a16f-f3001005ad70 tempest-VolumesActionsTest-807172941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-42d28133-4b3c-471b-a16f-f3001005ad70 tempest-VolumesActionsTest-807172941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-42d28133-4b3c-471b-a16f-f3001005ad70 tempest-VolumesActionsTest-807172941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-42d28133-4b3c-471b-a16f-f3001005ad70 tempest-VolumesActionsTest-807172941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:18 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:11:18 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:18 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-42d28133-4b3c-471b-a16f-f3001005ad70 tempest-VolumesActionsTest-807172941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.455s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:18 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-42d28133-4b3c-471b-a16f-f3001005ad70 tempest-VolumesActionsTest-807172941 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:11:18 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-42d28133-4b3c-471b-a16f-f3001005ad70 tempest-VolumesActionsTest-807172941 None] Deleted volume successfully. Sep 28 18:11:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-42d28133-4b3c-471b-a16f-f3001005ad70 tempest-VolumesActionsTest-807172941 None] Lock "cinder-76206a76-e602-4666-90eb-971e1cf1807a-delete_volume" released by "delete_volume" :: held 2.315s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:20 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:11:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Flow 'volume_create_manager' (2e1e8388-400d-416b-ae34-21b8b6d6c5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9111df-3b90-47e2-a3dc-865dacb34790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9111df-3b90-47e2-a3dc-865dacb34790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1843419496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d2affcf-8b84-4163-9967-3ebf46c4e025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0747e3ae27144c098ba8696ad30b939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:20Z,use_quota=True,user_id='c382dfb8494c42978fbb04237342a584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a1b300-f792-4950-9f49-6ea0de583529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a1b300-f792-4950-9f49-6ea0de583529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5fcbc16-d664-46d0-adcb-ea4dc37cd38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5fcbc16-d664-46d0-adcb-ea4dc37cd38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d2affcf-8b84-4163-9967-3ebf46c4e025', 'volume_name': 'volume-6d2affcf-8b84-4163-9967-3ebf46c4e025', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7696cf18-8b9b-4d1c-8075-b6154a531478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7696cf18-8b9b-4d1c-8075-b6154a531478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b20eeb9-2ed6-40ea-9640-9078e5b0a68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:20 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Volume 6d2affcf-8b84-4163-9967-3ebf46c4e025: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d2affcf-8b84-4163-9967-3ebf46c4e025', 'volume_size': 1} Sep 28 18:11:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:20 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1843419496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d2affcf-8b84-4163-9967-3ebf46c4e025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0747e3ae27144c098ba8696ad30b939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:20Z,use_quota=True,user_id='c382dfb8494c42978fbb04237342a584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:11:20 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Creating volume 6d2affcf-8b84-4163-9967-3ebf46c4e025 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:11:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:20 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:20 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:20 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:11:20 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:11:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6d2affcf-8b84-4163-9967-3ebf46c4e025 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:20 devstack sudo[96134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6d2affcf-8b84-4163-9967-3ebf46c4e025 1073741824 Sep 28 18:11:20 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:21 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6d2affcf-8b84-4163-9967-3ebf46c4e025 1073741824" returned: 0 in 0.835s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6d2affcf-8b84-4163-9967-3ebf46c4e025 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:21 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6d2affcf-8b84-4163-9967-3ebf46c4e025 Sep 28 18:11:21 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:21 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6d2affcf-8b84-4163-9967-3ebf46c4e025" returned: 0 in 0.479s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:21 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:11:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.408s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b20eeb9-2ed6-40ea-9640-9078e5b0a68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d2affcf-8b84-4163-9967-3ebf46c4e025', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814589b8-d34d-4998-b07d-4a9f6266788c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:22 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Volume volume-6d2affcf-8b84-4163-9967-3ebf46c4e025 (6d2affcf-8b84-4163-9967-3ebf46c4e025): created successfully Sep 28 18:11:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814589b8-d34d-4998-b07d-4a9f6266788c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Flow 'volume_create_manager' (2e1e8388-400d-416b-ae34-21b8b6d6c5d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:22 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-f89104d8-d999-493c-89a6-694d0029622a tempest-VolumesActionsTest-1955705005 None] Created volume successfully. Sep 28 18:11:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-af3f98b7-b912-4ac4-8d3f-ddeb2cc008ac tempest-VolumesActionsTest-1955705005 None] Acquiring lock "cinder-6d2affcf-8b84-4163-9967-3ebf46c4e025-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-af3f98b7-b912-4ac4-8d3f-ddeb2cc008ac tempest-VolumesActionsTest-1955705005 None] Lock "cinder-6d2affcf-8b84-4163-9967-3ebf46c4e025-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-af3f98b7-b912-4ac4-8d3f-ddeb2cc008ac tempest-VolumesActionsTest-1955705005 None] Acquiring lock "cinder-quobyte-6d2affcf-8b84-4163-9967-3ebf46c4e025" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-af3f98b7-b912-4ac4-8d3f-ddeb2cc008ac tempest-VolumesActionsTest-1955705005 None] Lock "cinder-quobyte-6d2affcf-8b84-4163-9967-3ebf46c4e025" acquired by "delete_volume" :: waited 0.028s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:23 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d28a5b-1c05-4522-a35b-c7216ba658af]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-af3f98b7-b912-4ac4-8d3f-ddeb2cc008ac tempest-VolumesActionsTest-1955705005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6d2affcf-8b84-4163-9967-3ebf46c4e025 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:24 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6d2affcf-8b84-4163-9967-3ebf46c4e025 Sep 28 18:11:24 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:24 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-af3f98b7-b912-4ac4-8d3f-ddeb2cc008ac tempest-VolumesActionsTest-1955705005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6d2affcf-8b84-4163-9967-3ebf46c4e025" returned: 0 in 0.579s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-af3f98b7-b912-4ac4-8d3f-ddeb2cc008ac tempest-VolumesActionsTest-1955705005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6d2affcf-8b84-4163-9967-3ebf46c4e025 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:24 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6d2affcf-8b84-4163-9967-3ebf46c4e025 Sep 28 18:11:24 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:24 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-af3f98b7-b912-4ac4-8d3f-ddeb2cc008ac tempest-VolumesActionsTest-1955705005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6d2affcf-8b84-4163-9967-3ebf46c4e025" returned: 0 in 0.372s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:24 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-af3f98b7-b912-4ac4-8d3f-ddeb2cc008ac tempest-VolumesActionsTest-1955705005 None] Lock "cinder-quobyte-6d2affcf-8b84-4163-9967-3ebf46c4e025" released by "delete_volume" :: held 1.030s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:25 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-af3f98b7-b912-4ac4-8d3f-ddeb2cc008ac tempest-VolumesActionsTest-1955705005 None] Created reservations ['ddb98b95-b052-4656-987e-1260c358487c', '79139819-6285-417b-8c19-7933fe94c841', '931ec04a-dd90-448a-b8f2-46ef30c6ff3c', 'd1ed9f8d-fa28-4aa2-bd0e-7cb8cd5e7b77'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:11:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-af3f98b7-b912-4ac4-8d3f-ddeb2cc008ac tempest-VolumesActionsTest-1955705005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-af3f98b7-b912-4ac4-8d3f-ddeb2cc008ac tempest-VolumesActionsTest-1955705005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:25 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-af3f98b7-b912-4ac4-8d3f-ddeb2cc008ac tempest-VolumesActionsTest-1955705005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:25 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-af3f98b7-b912-4ac4-8d3f-ddeb2cc008ac tempest-VolumesActionsTest-1955705005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-af3f98b7-b912-4ac4-8d3f-ddeb2cc008ac tempest-VolumesActionsTest-1955705005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-af3f98b7-b912-4ac4-8d3f-ddeb2cc008ac tempest-VolumesActionsTest-1955705005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:25 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:11:25 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:25 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-af3f98b7-b912-4ac4-8d3f-ddeb2cc008ac tempest-VolumesActionsTest-1955705005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.359s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:25 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-af3f98b7-b912-4ac4-8d3f-ddeb2cc008ac tempest-VolumesActionsTest-1955705005 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:11:25 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-af3f98b7-b912-4ac4-8d3f-ddeb2cc008ac tempest-VolumesActionsTest-1955705005 None] Deleted volume successfully. Sep 28 18:11:25 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-af3f98b7-b912-4ac4-8d3f-ddeb2cc008ac tempest-VolumesActionsTest-1955705005 None] Lock "cinder-6d2affcf-8b84-4163-9967-3ebf46c4e025-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:29 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:11:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Flow 'volume_create_manager' (ba8c931d-b668-4364-907c-54232c785ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a4afb3a-8bb1-4f8a-b26d-7e86a718ec37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a4afb3a-8bb1-4f8a-b26d-7e86a718ec37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1143047207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a61aad8-1305-43a8-ab9a-49b6233d2899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b5fbc0b8554b2ea7ccc7749edfd5e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:30Z,use_quota=True,user_id='f36b0c32d3bd4dbba3126a974f880783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68469538-2dff-4f80-9d27-3c0eed2d8770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68469538-2dff-4f80-9d27-3c0eed2d8770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89d1cc6d-c0cf-480b-8446-98351ec2d932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89d1cc6d-c0cf-480b-8446-98351ec2d932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a61aad8-1305-43a8-ab9a-49b6233d2899', 'volume_name': 'volume-2a61aad8-1305-43a8-ab9a-49b6233d2899', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1160031-473f-425a-ac80-14718f6e5c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1160031-473f-425a-ac80-14718f6e5c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a3f9fdf-1f5e-41e4-9324-96847d07d047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:29 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Volume 2a61aad8-1305-43a8-ab9a-49b6233d2899: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a61aad8-1305-43a8-ab9a-49b6233d2899', 'volume_size': 1} Sep 28 18:11:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1143047207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a61aad8-1305-43a8-ab9a-49b6233d2899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b5fbc0b8554b2ea7ccc7749edfd5e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:30Z,use_quota=True,user_id='f36b0c32d3bd4dbba3126a974f880783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:11:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Creating volume 2a61aad8-1305-43a8-ab9a-49b6233d2899 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:11:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:11:29 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:11:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:29 devstack sudo[96242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899 1073741824 Sep 28 18:11:29 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:30 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899 1073741824" returned: 0 in 0.659s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:30 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899 Sep 28 18:11:30 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:30 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899" returned: 0 in 0.398s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:30 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:11:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:30 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a3f9fdf-1f5e-41e4-9324-96847d07d047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a61aad8-1305-43a8-ab9a-49b6233d2899', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:30 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18edaeaf-13a4-4d06-b745-0b880d1d7d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:31 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Volume volume-2a61aad8-1305-43a8-ab9a-49b6233d2899 (2a61aad8-1305-43a8-ab9a-49b6233d2899): created successfully Sep 28 18:11:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18edaeaf-13a4-4d06-b745-0b880d1d7d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Flow 'volume_create_manager' (ba8c931d-b668-4364-907c-54232c785ba1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:31 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-389b2f8e-c665-4edd-9375-45bb1129fa77 tempest-VolumesCloneTest-788130963 None] Created volume successfully. Sep 28 18:11:32 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:11:32 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Flow 'volume_create_manager' (7aafb039-4a3b-448f-a1e3-2c1a6f7e9c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:32 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88169f55-b0a9-4bb9-9a9d-155b1d548d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:32 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88169f55-b0a9-4bb9-9a9d-155b1d548d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-518330145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bc444e7-74be-4d86-afa6-44ed14bcb4cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b5fbc0b8554b2ea7ccc7749edfd5e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=2a61aad8-1305-43a8-ab9a-49b6233d2899,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:33Z,use_quota=True,user_id='f36b0c32d3bd4dbba3126a974f880783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:32 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b325830a-9eea-48fb-a19e-174d8f640b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:32 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b325830a-9eea-48fb-a19e-174d8f640b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:32 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd1ca47e-adab-4637-b39b-296d1b2b1828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd1ca47e-adab-4637-b39b-296d1b2b1828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3bc444e7-74be-4d86-afa6-44ed14bcb4cf', 'volume_name': 'volume-3bc444e7-74be-4d86-afa6-44ed14bcb4cf', 'volume_size': 2, 'source_volid': '2a61aad8-1305-43a8-ab9a-49b6233d2899', 'source_volstatus': 'available'}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958089ca-8088-4667-9046-131001419149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958089ca-8088-4667-9046-131001419149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d59bbf-5230-482c-b568-82c140c37731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:33 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Volume 3bc444e7-74be-4d86-afa6-44ed14bcb4cf: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3bc444e7-74be-4d86-afa6-44ed14bcb4cf', 'volume_size': 2, 'source_volid': '2a61aad8-1305-43a8-ab9a-49b6233d2899', 'source_volstatus': 'available'} Sep 28 18:11:33 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:11:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Flow 'volume_create_manager' (f0ddd2a8-4dcf-46f0-b5a7-db669495a380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c72d5d-7612-46ae-aa23-c62e4147f364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:33 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Cloning volume 2a61aad8-1305-43a8-ab9a-49b6233d2899 to volume 3bc444e7-74be-4d86-afa6-44ed14bcb4cf Sep 28 18:11:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c72d5d-7612-46ae-aa23-c62e4147f364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1271489859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa033634-8494-4a91-92f0-f50e03fffd4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfec1b5d7a5348e1be3e4501602d52da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:33Z,use_quota=True,user_id='105f64396c1f47ad8dd488d607964de0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b587ce9-31bb-44cb-8103-b1dc2ff09a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b587ce9-31bb-44cb-8103-b1dc2ff09a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e9afd7-f5ef-40f7-81f2-9cfe5d06d5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e9afd7-f5ef-40f7-81f2-9cfe5d06d5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa033634-8494-4a91-92f0-f50e03fffd4f', 'volume_name': 'volume-fa033634-8494-4a91-92f0-f50e03fffd4f', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce6d019f-ff9f-4e43-abdf-1133edb4cf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce6d019f-ff9f-4e43-abdf-1133edb4cf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf087254-0206-4d62-a986-7d7b04754237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:33 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Volume fa033634-8494-4a91-92f0-f50e03fffd4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa033634-8494-4a91-92f0-f50e03fffd4f', 'volume_size': 1} Sep 28 18:11:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Creating offline snapshot 682cbcc8-0455-4f81-b615-5ef4f242ecde of volume 2a61aad8-1305-43a8-ab9a-49b6233d2899 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:11:33 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5459a9-cfb8-4637-a32d-980c27157ae9]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:33 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899 Sep 28 18:11:33 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:33 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899" returned: 0 in 0.650s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.682cbcc8-0455-4f81-b615-5ef4f242ecde 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:33 devstack sudo[96259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.682cbcc8-0455-4f81-b615-5ef4f242ecde 1G Sep 28 18:11:33 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:34 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.682cbcc8-0455-4f81-b615-5ef4f242ecde 1G" returned: 0 in 0.574s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a61aad8-1305-43a8-ab9a-49b6233d2899 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.682cbcc8-0455-4f81-b615-5ef4f242ecde {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:34 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a61aad8-1305-43a8-ab9a-49b6233d2899 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.682cbcc8-0455-4f81-b615-5ef4f242ecde Sep 28 18:11:34 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:34 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a61aad8-1305-43a8-ab9a-49b6233d2899 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.682cbcc8-0455-4f81-b615-5ef4f242ecde" returned: 0 in 0.473s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:34 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.682cbcc8-0455-4f81-b615-5ef4f242ecde is being set with open permissions: ugo+rw Sep 28 18:11:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.682cbcc8-0455-4f81-b615-5ef4f242ecde {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:34 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.682cbcc8-0455-4f81-b615-5ef4f242ecde Sep 28 18:11:35 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:35 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.682cbcc8-0455-4f81-b615-5ef4f242ecde" returned: 0 in 0.407s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:35 devstack sudo[96274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.info Sep 28 18:11:35 devstack sudo[96274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:35 devstack sudo[96274]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.info" returned: 0 in 0.408s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:35 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.info is being set with open permissions: ugo+rw Sep 28 18:11:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:35 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.info Sep 28 18:11:35 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:36 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.info" returned: 0 in 0.480s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:36 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Acquiring lock "cinder-quobyte-3bc444e7-74be-4d86-afa6-44ed14bcb4cf" by "_copy_volume_from_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:36 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Lock "cinder-quobyte-3bc444e7-74be-4d86-afa6-44ed14bcb4cf" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] snapshot: 682cbcc8-0455-4f81-b615-5ef4f242ecde, volume: 3bc444e7-74be-4d86-afa6-44ed14bcb4cf, {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:11:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:36 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[187e4fe0-b5ad-4322-b8a4-6f4d299737a2]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.682cbcc8-0455-4f81-b615-5ef4f242ecde {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:36 devstack sudo[96281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.682cbcc8-0455-4f81-b615-5ef4f242ecde Sep 28 18:11:36 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:37 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.682cbcc8-0455-4f81-b615-5ef4f242ecde" returned: 0 in 0.647s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a61aad8-1305-43a8-ab9a-49b6233d2899(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:11:37 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b2fa24-4276-4466-ad97-f1ae69a37348]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:37 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899 Sep 28 18:11:37 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:37 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899" returned: 0 in 0.444s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899 {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:11:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Creating direct copy from snapshot {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:11:37 devstack cinder-volume[86980]: DEBUG cinder.utils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Path /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3bc444e7-74be-4d86-afa6-44ed14bcb4cf not found in is_blk_device check {{(pid=86980) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:11:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3bc444e7-74be-4d86-afa6-44ed14bcb4cf {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:37 devstack sudo[96293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3bc444e7-74be-4d86-afa6-44ed14bcb4cf Sep 28 18:11:37 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:45 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=60,cinder:UPDATE=86,cinder:DELETE=6,cinder:INSERT=16 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:11:45 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:UPDATE=77,cinder:SELECT=56,cinder:INSERT=22,cinder:DELETE=9 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:11:47 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3bc444e7-74be-4d86-afa6-44ed14bcb4cf" returned: 0 in 9.632s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:47 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Image conversion details: src /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899, size 1024.00 MB, duration 9.63 sec, destination /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3bc444e7-74be-4d86-afa6-44ed14bcb4cf {{(pid=86980) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:11:47 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Converted 1024.00 MB image at 106.28 MB/s Sep 28 18:11:47 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3bc444e7-74be-4d86-afa6-44ed14bcb4cf is being set with open permissions: ugo+rw Sep 28 18:11:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3bc444e7-74be-4d86-afa6-44ed14bcb4cf {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:47 devstack sudo[96313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3bc444e7-74be-4d86-afa6-44ed14bcb4cf Sep 28 18:11:47 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:47 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3bc444e7-74be-4d86-afa6-44ed14bcb4cf" returned: 0 in 0.432s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Lock "cinder-quobyte-3bc444e7-74be-4d86-afa6-44ed14bcb4cf" released by "_copy_volume_from_snapshot" :: held 11.273s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Acquiring lock "cinder-quobyte-682cbcc8-0455-4f81-b615-5ef4f242ecde" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Lock "cinder-quobyte-682cbcc8-0455-4f81-b615-5ef4f242ecde" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:47 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Deleting offline snapshot 682cbcc8-0455-4f81-b615-5ef4f242ecde of volume 2a61aad8-1305-43a8-ab9a-49b6233d2899 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:11:47 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] snapshot_file for this snap is: volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.682cbcc8-0455-4f81-b615-5ef4f242ecde {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:11:47 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[acff9a76-892e-4c9a-87c2-ce4005d8dfee]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.682cbcc8-0455-4f81-b615-5ef4f242ecde {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:47 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.682cbcc8-0455-4f81-b615-5ef4f242ecde Sep 28 18:11:47 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:48 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.682cbcc8-0455-4f81-b615-5ef4f242ecde" returned: 0 in 0.554s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:48 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a61aad8-1305-43a8-ab9a-49b6233d2899(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:11:48 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[00af844f-d70e-4e2c-93d0-958a727d0e85]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:48 devstack sudo[96324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899 Sep 28 18:11:48 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:49 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899" returned: 0 in 0.903s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.682cbcc8-0455-4f81-b615-5ef4f242ecde {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:49 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.682cbcc8-0455-4f81-b615-5ef4f242ecde Sep 28 18:11:49 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:49 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.682cbcc8-0455-4f81-b615-5ef4f242ecde" returned: 0 in 0.606s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.682cbcc8-0455-4f81-b615-5ef4f242ecde {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:49 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.682cbcc8-0455-4f81-b615-5ef4f242ecde Sep 28 18:11:49 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:50 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899.682cbcc8-0455-4f81-b615-5ef4f242ecde" returned: 0 in 0.508s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:50 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Lock "cinder-quobyte-682cbcc8-0455-4f81-b615-5ef4f242ecde" released by "_delete_snapshot" :: held 2.782s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.439s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.386s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1271489859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa033634-8494-4a91-92f0-f50e03fffd4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfec1b5d7a5348e1be3e4501602d52da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:33Z,use_quota=True,user_id='105f64396c1f47ad8dd488d607964de0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:11:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Creating volume fa033634-8494-4a91-92f0-f50e03fffd4f {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:11:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:11:50 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:11:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d59bbf-5230-482c-b568-82c140c37731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bc444e7-74be-4d86-afa6-44ed14bcb4cf', 'volume_size': 2, 'source_volid': '2a61aad8-1305-43a8-ab9a-49b6233d2899', 'source_volstatus': 'available'}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:50 devstack sudo[96400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f 1073741824 Sep 28 18:11:50 devstack sudo[96400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b662550f-f773-4f82-9032-23df5b35e991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:50 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Volume volume-3bc444e7-74be-4d86-afa6-44ed14bcb4cf (3bc444e7-74be-4d86-afa6-44ed14bcb4cf): created successfully Sep 28 18:11:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b662550f-f773-4f82-9032-23df5b35e991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Flow 'volume_create_manager' (7aafb039-4a3b-448f-a1e3-2c1a6f7e9c4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:50 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-c14538d9-be35-495c-a3ef-952ba1c5210f tempest-VolumesCloneTest-788130963 None] Created volume successfully. Sep 28 18:11:51 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:11:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Flow 'volume_create_manager' (27adfc88-809a-4e93-800c-d277b088db33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:51 devstack sudo[96400]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b35533-2f80-421c-9a38-ca389f8ff743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f 1073741824" returned: 0 in 0.759s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b35533-2f80-421c-9a38-ca389f8ff743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1148839151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=200d5605-a290-4143-8fab-fb14acf7097b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c61214f46be42978330b2f7e324a507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:51Z,use_quota=True,user_id='1e0f904a44b74d208fdd2f30799970d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca229cff-2858-44e3-8661-51ede6e866c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca229cff-2858-44e3-8661-51ede6e866c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2bb249d-0cee-4585-b871-245405c10886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:51 devstack cinder-volume[86980]: DEBUG cinder.image.glance [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Creating Keystone auth plugin from conf {{(pid=86980) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:11:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:51 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f Sep 28 18:11:51 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2bb249d-0cee-4585-b871-245405c10886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '200d5605-a290-4143-8fab-fb14acf7097b', 'volume_name': 'volume-200d5605-a290-4143-8fab-fb14acf7097b', 'volume_size': 1, 'image_id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c13a4cea8f714bb0b9012709acb9372b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'created_at': datetime.datetime(2026, 9, 28, 15, 57, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 57, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a72149-31ae-4d73-a0aa-3c1180edf7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a72149-31ae-4d73-a0aa-3c1180edf7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f58b230-8af5-4cfe-9331-a8329b619249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:51 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Volume 200d5605-a290-4143-8fab-fb14acf7097b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-200d5605-a290-4143-8fab-fb14acf7097b', 'volume_size': 1, 'image_id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c13a4cea8f714bb0b9012709acb9372b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'created_at': datetime.datetime(2026, 9, 28, 15, 57, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 57, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 18:11:51 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Trying to clone 200d5605-a290-4143-8fab-fb14acf7097b from image d5838d4d-ebb7-4d18-8c3c-fc660c294083 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}]). {{(pid=86980) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:11:51 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f" returned: 0 in 0.436s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:51 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:11:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf087254-0206-4d62-a986-7d7b04754237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa033634-8494-4a91-92f0-f50e03fffd4f', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5321d606-878e-489d-a0b4-43b5da773890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:11:51 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Volume volume-fa033634-8494-4a91-92f0-f50e03fffd4f (fa033634-8494-4a91-92f0-f50e03fffd4f): created successfully Sep 28 18:11:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5321d606-878e-489d-a0b4-43b5da773890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:11:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Flow 'volume_create_manager' (f0ddd2a8-4dcf-46f0-b5a7-db669495a380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:11:52 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-d770ccce-a3df-45f0-964a-afe8555cdb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Created volume successfully. Sep 28 18:11:52 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_3mr7vo2tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:11:52 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Image download 20.69 MB at 20.69 MB/s Sep 28 18:11:52 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d9a720-d675-429c-a509-fd1638a6234a]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_3mr7vo2tdevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:52 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c7f76755-7278-4022-aec0-8f61359194b4 tempest-VolumesCloneTest-788130963 None] Acquiring lock "cinder-3bc444e7-74be-4d86-afa6-44ed14bcb4cf-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:52 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c7f76755-7278-4022-aec0-8f61359194b4 tempest-VolumesCloneTest-788130963 None] Lock "cinder-3bc444e7-74be-4d86-afa6-44ed14bcb4cf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:52 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c7f76755-7278-4022-aec0-8f61359194b4 tempest-VolumesCloneTest-788130963 None] Acquiring lock "cinder-quobyte-3bc444e7-74be-4d86-afa6-44ed14bcb4cf" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:52 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c7f76755-7278-4022-aec0-8f61359194b4 tempest-VolumesCloneTest-788130963 None] Lock "cinder-quobyte-3bc444e7-74be-4d86-afa6-44ed14bcb4cf" acquired by "delete_volume" :: waited 0.031s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:52 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_3mr7vo2tdevstack@QuobyteHD Sep 28 18:11:52 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:52 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f1f3cc-1532-4194-9e3e-a0fb9e881c0a]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c7f76755-7278-4022-aec0-8f61359194b4 tempest-VolumesCloneTest-788130963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3bc444e7-74be-4d86-afa6-44ed14bcb4cf {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:52 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3bc444e7-74be-4d86-afa6-44ed14bcb4cf Sep 28 18:11:52 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:52 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_3mr7vo2tdevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:52 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Temporary image d5838d4d-ebb7-4d18-8c3c-fc660c294083 is fetched for user 1e0f904a44b74d208fdd2f30799970d4. {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:11:53 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac402028-80d9-4e91-a470-dcf992bc2eac]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_3mr7vo2tdevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:53 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c7f76755-7278-4022-aec0-8f61359194b4 tempest-VolumesCloneTest-788130963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3bc444e7-74be-4d86-afa6-44ed14bcb4cf" returned: 0 in 0.443s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c7f76755-7278-4022-aec0-8f61359194b4 tempest-VolumesCloneTest-788130963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3bc444e7-74be-4d86-afa6-44ed14bcb4cf {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:53 devstack sudo[96425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3bc444e7-74be-4d86-afa6-44ed14bcb4cf Sep 28 18:11:53 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:53 devstack sudo[96423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_3mr7vo2tdevstack@QuobyteHD Sep 28 18:11:53 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:53 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5d2b853e-a06e-4aa0-a0d2-bccc9ea10a0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5d2b853e-a06e-4aa0-a0d2-bccc9ea10a0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_3mr7vo2tdevstack@QuobyteHD" returned: 0 in 0.575s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-5d2b853e-a06e-4aa0-a0d2-bccc9ea10a0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Creating offline snapshot f0f6d194-4612-461e-8881-f7ed988fa9c1 of volume fa033634-8494-4a91-92f0-f50e03fffd4f {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:11:53 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1febafa-64de-4445-85fc-0fa952dfc841]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5d2b853e-a06e-4aa0-a0d2-bccc9ea10a0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:53 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c7f76755-7278-4022-aec0-8f61359194b4 tempest-VolumesCloneTest-788130963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3bc444e7-74be-4d86-afa6-44ed14bcb4cf" returned: 0 in 0.617s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:53 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c7f76755-7278-4022-aec0-8f61359194b4 tempest-VolumesCloneTest-788130963 None] Lock "cinder-quobyte-3bc444e7-74be-4d86-afa6-44ed14bcb4cf" released by "delete_volume" :: held 1.149s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:53 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-c7f76755-7278-4022-aec0-8f61359194b4 tempest-VolumesCloneTest-788130963 None] Created reservations ['7314a5ac-c408-498d-93c7-29a43a79b5e8', '9fcee32c-1fba-473d-a930-da5680ff1315', 'e6ca85f6-6630-480d-9c57-c1bedf6d553b', 'ed64c4c3-5365-4dc1-816f-486dece1bca4'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:11:53 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f Sep 28 18:11:53 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c7f76755-7278-4022-aec0-8f61359194b4 tempest-VolumesCloneTest-788130963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c7f76755-7278-4022-aec0-8f61359194b4 tempest-VolumesCloneTest-788130963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c7f76755-7278-4022-aec0-8f61359194b4 tempest-VolumesCloneTest-788130963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c7f76755-7278-4022-aec0-8f61359194b4 tempest-VolumesCloneTest-788130963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c7f76755-7278-4022-aec0-8f61359194b4 tempest-VolumesCloneTest-788130963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c7f76755-7278-4022-aec0-8f61359194b4 tempest-VolumesCloneTest-788130963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:54 devstack sudo[96434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:11:54 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:54 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5d2b853e-a06e-4aa0-a0d2-bccc9ea10a0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f" returned: 0 in 0.649s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5d2b853e-a06e-4aa0-a0d2-bccc9ea10a0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f.f0f6d194-4612-461e-8881-f7ed988fa9c1 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:54 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c7f76755-7278-4022-aec0-8f61359194b4 tempest-VolumesCloneTest-788130963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.340s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:54 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-c7f76755-7278-4022-aec0-8f61359194b4 tempest-VolumesCloneTest-788130963 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:11:54 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-c7f76755-7278-4022-aec0-8f61359194b4 tempest-VolumesCloneTest-788130963 None] Deleted volume successfully. Sep 28 18:11:54 devstack sudo[96440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f.f0f6d194-4612-461e-8881-f7ed988fa9c1 1G Sep 28 18:11:54 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:54 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c7f76755-7278-4022-aec0-8f61359194b4 tempest-VolumesCloneTest-788130963 None] Lock "cinder-3bc444e7-74be-4d86-afa6-44ed14bcb4cf-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:54 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1029b124-538d-4fb9-8122-af2340bd78b5 tempest-AttachVolumeShelveTestJSON-397274229 None] Acquiring lock "cinder-09ff0928-1dc8-4f2b-ad56-282d28925a6d-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:54 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1029b124-538d-4fb9-8122-af2340bd78b5 tempest-AttachVolumeShelveTestJSON-397274229 None] Lock "cinder-09ff0928-1dc8-4f2b-ad56-282d28925a6d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:54 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1029b124-538d-4fb9-8122-af2340bd78b5 tempest-AttachVolumeShelveTestJSON-397274229 None] Acquiring lock "cinder-quobyte-09ff0928-1dc8-4f2b-ad56-282d28925a6d" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:54 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1029b124-538d-4fb9-8122-af2340bd78b5 tempest-AttachVolumeShelveTestJSON-397274229 None] Lock "cinder-quobyte-09ff0928-1dc8-4f2b-ad56-282d28925a6d" acquired by "delete_volume" :: waited 0.021s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:54 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3140cd06-732c-488f-bc5f-d1c144e9fe76]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1029b124-538d-4fb9-8122-af2340bd78b5 tempest-AttachVolumeShelveTestJSON-397274229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-09ff0928-1dc8-4f2b-ad56-282d28925a6d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:54 devstack sudo[96445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-09ff0928-1dc8-4f2b-ad56-282d28925a6d Sep 28 18:11:54 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:54 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5d2b853e-a06e-4aa0-a0d2-bccc9ea10a0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f.f0f6d194-4612-461e-8881-f7ed988fa9c1 1G" returned: 0 in 0.648s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5d2b853e-a06e-4aa0-a0d2-bccc9ea10a0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa033634-8494-4a91-92f0-f50e03fffd4f -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f.f0f6d194-4612-461e-8881-f7ed988fa9c1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:54 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa033634-8494-4a91-92f0-f50e03fffd4f -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f.f0f6d194-4612-461e-8881-f7ed988fa9c1 Sep 28 18:11:54 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d4aa360f-0092-403b-8672-a80c6d93a95c tempest-VolumesCloneTest-788130963 None] Acquiring lock "cinder-2a61aad8-1305-43a8-ab9a-49b6233d2899-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d4aa360f-0092-403b-8672-a80c6d93a95c tempest-VolumesCloneTest-788130963 None] Lock "cinder-2a61aad8-1305-43a8-ab9a-49b6233d2899-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d4aa360f-0092-403b-8672-a80c6d93a95c tempest-VolumesCloneTest-788130963 None] Acquiring lock "cinder-quobyte-2a61aad8-1305-43a8-ab9a-49b6233d2899" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d4aa360f-0092-403b-8672-a80c6d93a95c tempest-VolumesCloneTest-788130963 None] Lock "cinder-quobyte-2a61aad8-1305-43a8-ab9a-49b6233d2899" acquired by "delete_volume" :: waited 0.023s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:55 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1029b124-538d-4fb9-8122-af2340bd78b5 tempest-AttachVolumeShelveTestJSON-397274229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-09ff0928-1dc8-4f2b-ad56-282d28925a6d" returned: 0 in 0.453s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1029b124-538d-4fb9-8122-af2340bd78b5 tempest-AttachVolumeShelveTestJSON-397274229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-09ff0928-1dc8-4f2b-ad56-282d28925a6d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:55 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9583a4b1-be83-48b7-b1f0-1613a734d985]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d4aa360f-0092-403b-8672-a80c6d93a95c tempest-VolumesCloneTest-788130963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:55 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-09ff0928-1dc8-4f2b-ad56-282d28925a6d Sep 28 18:11:55 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:55 devstack sudo[96455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899 Sep 28 18:11:55 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:55 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5d2b853e-a06e-4aa0-a0d2-bccc9ea10a0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa033634-8494-4a91-92f0-f50e03fffd4f -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f.f0f6d194-4612-461e-8881-f7ed988fa9c1" returned: 0 in 0.477s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:55 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-5d2b853e-a06e-4aa0-a0d2-bccc9ea10a0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f.f0f6d194-4612-461e-8881-f7ed988fa9c1 is being set with open permissions: ugo+rw Sep 28 18:11:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5d2b853e-a06e-4aa0-a0d2-bccc9ea10a0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f.f0f6d194-4612-461e-8881-f7ed988fa9c1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:55 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f.f0f6d194-4612-461e-8881-f7ed988fa9c1 Sep 28 18:11:55 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:55 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1029b124-538d-4fb9-8122-af2340bd78b5 tempest-AttachVolumeShelveTestJSON-397274229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-09ff0928-1dc8-4f2b-ad56-282d28925a6d" returned: 0 in 0.350s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1029b124-538d-4fb9-8122-af2340bd78b5 tempest-AttachVolumeShelveTestJSON-397274229 None] Lock "cinder-quobyte-09ff0928-1dc8-4f2b-ad56-282d28925a6d" released by "delete_volume" :: held 0.874s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:55 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-1029b124-538d-4fb9-8122-af2340bd78b5 tempest-AttachVolumeShelveTestJSON-397274229 None] Created reservations ['99d29cec-5d65-42ec-a155-5dc616144270', 'd0508c6b-93d7-4ba3-b46f-4bf29266c8ae', 'd7cd3f64-64be-4011-a9a5-b1923114c25b', '3cc935ef-d36e-4032-87d7-74c826694d72'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:11:55 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d4aa360f-0092-403b-8672-a80c6d93a95c tempest-VolumesCloneTest-788130963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899" returned: 0 in 0.468s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d4aa360f-0092-403b-8672-a80c6d93a95c tempest-VolumesCloneTest-788130963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:55 devstack sudo[96468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899 Sep 28 18:11:55 devstack sudo[96468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:55 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5d2b853e-a06e-4aa0-a0d2-bccc9ea10a0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f.f0f6d194-4612-461e-8881-f7ed988fa9c1" returned: 0 in 0.371s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1029b124-538d-4fb9-8122-af2340bd78b5 tempest-AttachVolumeShelveTestJSON-397274229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1029b124-538d-4fb9-8122-af2340bd78b5 tempest-AttachVolumeShelveTestJSON-397274229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:55 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1029b124-538d-4fb9-8122-af2340bd78b5 tempest-AttachVolumeShelveTestJSON-397274229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:55 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1029b124-538d-4fb9-8122-af2340bd78b5 tempest-AttachVolumeShelveTestJSON-397274229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1029b124-538d-4fb9-8122-af2340bd78b5 tempest-AttachVolumeShelveTestJSON-397274229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1029b124-538d-4fb9-8122-af2340bd78b5 tempest-AttachVolumeShelveTestJSON-397274229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:55 devstack sudo[96471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:11:55 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5d2b853e-a06e-4aa0-a0d2-bccc9ea10a0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:55 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f.info Sep 28 18:11:55 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:56 devstack sudo[96468]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d4aa360f-0092-403b-8672-a80c6d93a95c tempest-VolumesCloneTest-788130963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a61aad8-1305-43a8-ab9a-49b6233d2899" returned: 0 in 0.380s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:56 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d4aa360f-0092-403b-8672-a80c6d93a95c tempest-VolumesCloneTest-788130963 None] Lock "cinder-quobyte-2a61aad8-1305-43a8-ab9a-49b6233d2899" released by "delete_volume" :: held 0.966s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:56 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-d4aa360f-0092-403b-8672-a80c6d93a95c tempest-VolumesCloneTest-788130963 None] Created reservations ['4ed486ea-2b91-4508-83f3-ed1eff45047d', 'e977ffe0-280c-4553-b96b-58967bfa0608', 'dc716c7f-e72d-4eea-acc9-cdcf9cd3c640', '567b97ff-6ea5-4ada-af1c-36cad5dfc339'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:11:56 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5d2b853e-a06e-4aa0-a0d2-bccc9ea10a0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f.info" returned: 0 in 0.360s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:56 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-5d2b853e-a06e-4aa0-a0d2-bccc9ea10a0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f.info is being set with open permissions: ugo+rw Sep 28 18:11:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5d2b853e-a06e-4aa0-a0d2-bccc9ea10a0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:56 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:56 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f.info Sep 28 18:11:56 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1029b124-538d-4fb9-8122-af2340bd78b5 tempest-AttachVolumeShelveTestJSON-397274229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.488s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:56 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-1029b124-538d-4fb9-8122-af2340bd78b5 tempest-AttachVolumeShelveTestJSON-397274229 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:11:56 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-1029b124-538d-4fb9-8122-af2340bd78b5 tempest-AttachVolumeShelveTestJSON-397274229 None] Deleted volume successfully. Sep 28 18:11:56 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1029b124-538d-4fb9-8122-af2340bd78b5 tempest-AttachVolumeShelveTestJSON-397274229 None] Lock "cinder-09ff0928-1dc8-4f2b-ad56-282d28925a6d-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d4aa360f-0092-403b-8672-a80c6d93a95c tempest-VolumesCloneTest-788130963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d4aa360f-0092-403b-8672-a80c6d93a95c tempest-VolumesCloneTest-788130963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d4aa360f-0092-403b-8672-a80c6d93a95c tempest-VolumesCloneTest-788130963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d4aa360f-0092-403b-8672-a80c6d93a95c tempest-VolumesCloneTest-788130963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d4aa360f-0092-403b-8672-a80c6d93a95c tempest-VolumesCloneTest-788130963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d4aa360f-0092-403b-8672-a80c6d93a95c tempest-VolumesCloneTest-788130963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:56 devstack sudo[96480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:11:56 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:56 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5d2b853e-a06e-4aa0-a0d2-bccc9ea10a0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f.info" returned: 0 in 0.303s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5d2b853e-a06e-4aa0-a0d2-bccc9ea10a0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.039s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.035s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1148839151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=200d5605-a290-4143-8fab-fb14acf7097b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c61214f46be42978330b2f7e324a507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:11:51Z,use_quota=True,user_id='1e0f904a44b74d208fdd2f30799970d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:11:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Creating volume 200d5605-a290-4143-8fab-fb14acf7097b {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:11:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:11:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:11:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:11:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:11:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:11:56 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:11:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-200d5605-a290-4143-8fab-fb14acf7097b 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:56 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-200d5605-a290-4143-8fab-fb14acf7097b 1073741824 Sep 28 18:11:56 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:56 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-5d2b853e-a06e-4aa0-a0d2-bccc9ea10a0d tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Create snapshot completed successfully Sep 28 18:11:56 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d4aa360f-0092-403b-8672-a80c6d93a95c tempest-VolumesCloneTest-788130963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.390s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:56 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-d4aa360f-0092-403b-8672-a80c6d93a95c tempest-VolumesCloneTest-788130963 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:11:56 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-d4aa360f-0092-403b-8672-a80c6d93a95c tempest-VolumesCloneTest-788130963 None] Deleted volume successfully. Sep 28 18:11:56 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d4aa360f-0092-403b-8672-a80c6d93a95c tempest-VolumesCloneTest-788130963 None] Lock "cinder-2a61aad8-1305-43a8-ab9a-49b6233d2899-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:11:57 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-200d5605-a290-4143-8fab-fb14acf7097b 1073741824" returned: 0 in 0.642s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-200d5605-a290-4143-8fab-fb14acf7097b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:57 devstack sudo[96490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-200d5605-a290-4143-8fab-fb14acf7097b Sep 28 18:11:57 devstack sudo[96490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:57 devstack sudo[96490]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-200d5605-a290-4143-8fab-fb14acf7097b" returned: 0 in 0.429s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:57 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:11:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:11:57 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Attempting download of d5838d4d-ebb7-4d18-8c3c-fc660c294083 ((None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}])) to volume 200d5605-a290-4143-8fab-fb14acf7097b. {{(pid=86980) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:11:57 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5635512c-7177-4ac5-8ecc-10c2c0a0633d]: (4, 'raw') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_lalp97rt {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:58 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_lalp97rt Sep 28 18:11:58 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:58 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-47ec97e2-d66a-4bfb-92a6-6323606b7ed6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Acquiring lock "cinder-f0f6d194-4612-461e-8881-f7ed988fa9c1-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:58 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:58 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-47ec97e2-d66a-4bfb-92a6-6323606b7ed6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Lock "cinder-f0f6d194-4612-461e-8881-f7ed988fa9c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:58 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-47ec97e2-d66a-4bfb-92a6-6323606b7ed6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Acquiring lock "cinder-quobyte-fa033634-8494-4a91-92f0-f50e03fffd4f" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_lalp97rt" returned: 0 in 0.613s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_lalp97rt {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:58 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-47ec97e2-d66a-4bfb-92a6-6323606b7ed6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Lock "cinder-quobyte-fa033634-8494-4a91-92f0-f50e03fffd4f" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:58 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-47ec97e2-d66a-4bfb-92a6-6323606b7ed6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Acquiring lock "cinder-quobyte-f0f6d194-4612-461e-8881-f7ed988fa9c1" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:11:58 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-47ec97e2-d66a-4bfb-92a6-6323606b7ed6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Lock "cinder-quobyte-f0f6d194-4612-461e-8881-f7ed988fa9c1" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:11:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-47ec97e2-d66a-4bfb-92a6-6323606b7ed6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Deleting offline snapshot f0f6d194-4612-461e-8881-f7ed988fa9c1 of volume fa033634-8494-4a91-92f0-f50e03fffd4f {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:11:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-47ec97e2-d66a-4bfb-92a6-6323606b7ed6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] snapshot_file for this snap is: volume-fa033634-8494-4a91-92f0-f50e03fffd4f.f0f6d194-4612-461e-8881-f7ed988fa9c1 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:11:58 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad198dc0-3a4d-40be-aafc-7f74e52ce7c1]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-47ec97e2-d66a-4bfb-92a6-6323606b7ed6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f.f0f6d194-4612-461e-8881-f7ed988fa9c1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:58 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_lalp97rt Sep 28 18:11:58 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:58 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f.f0f6d194-4612-461e-8881-f7ed988fa9c1 Sep 28 18:11:58 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:58 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_lalp97rt" returned: 1 in 0.436s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_lalp97rt' failed. Not Retrying. {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:11:58 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e5f47e-632b-4809-b0b1-da2379c1dab7]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_3mr7vo2tdevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:59 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_3mr7vo2tdevstack@QuobyteHD Sep 28 18:11:59 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:59 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-47ec97e2-d66a-4bfb-92a6-6323606b7ed6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f.f0f6d194-4612-461e-8881-f7ed988fa9c1" returned: 0 in 0.707s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-47ec97e2-d66a-4bfb-92a6-6323606b7ed6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa033634-8494-4a91-92f0-f50e03fffd4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:11:59 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcd9dfa-2bf3-4c55-a7a5-0d087f642f96]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:11:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-47ec97e2-d66a-4bfb-92a6-6323606b7ed6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:59 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f Sep 28 18:11:59 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:11:59 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Sep 28 18:11:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_3mr7vo2tdevstack@QuobyteHD" returned: 0 in 0.594s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:11:59 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] d5838d4d-ebb7-4d18-8c3c-fc660c294083 was qcow2, converting to qcow2 {{(pid=86980) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:11:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_3mr7vo2tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-200d5605-a290-4143-8fab-fb14acf7097b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:11:59 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_3mr7vo2tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-200d5605-a290-4143-8fab-fb14acf7097b Sep 28 18:11:59 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:00 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-47ec97e2-d66a-4bfb-92a6-6323606b7ed6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f" returned: 0 in 0.636s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-47ec97e2-d66a-4bfb-92a6-6323606b7ed6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f.f0f6d194-4612-461e-8881-f7ed988fa9c1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:00 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f.f0f6d194-4612-461e-8881-f7ed988fa9c1 Sep 28 18:12:00 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:00 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-47ec97e2-d66a-4bfb-92a6-6323606b7ed6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f.f0f6d194-4612-461e-8881-f7ed988fa9c1" returned: 0 in 0.549s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-47ec97e2-d66a-4bfb-92a6-6323606b7ed6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f.f0f6d194-4612-461e-8881-f7ed988fa9c1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:00 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f.f0f6d194-4612-461e-8881-f7ed988fa9c1 Sep 28 18:12:00 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:00 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-47ec97e2-d66a-4bfb-92a6-6323606b7ed6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f.f0f6d194-4612-461e-8881-f7ed988fa9c1" returned: 0 in 0.395s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-47ec97e2-d66a-4bfb-92a6-6323606b7ed6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Lock "cinder-quobyte-f0f6d194-4612-461e-8881-f7ed988fa9c1" released by "_delete_snapshot" :: held 2.495s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-47ec97e2-d66a-4bfb-92a6-6323606b7ed6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Lock "cinder-quobyte-fa033634-8494-4a91-92f0-f50e03fffd4f" released by "delete_snapshot" :: held 2.538s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:01 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-47ec97e2-d66a-4bfb-92a6-6323606b7ed6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Created reservations ['4d47e2da-2757-4d8f-8204-7630506bf54a', '85644754-4394-4fc7-9ca4-8d2a9e3132a6', '1e4ea6f3-9993-4f0b-b0f6-38f99abf7f15', '2801d6a0-b10a-454f-92cd-b66add1a57b8'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:01 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-47ec97e2-d66a-4bfb-92a6-6323606b7ed6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Delete snapshot completed successfully. Sep 28 18:12:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-47ec97e2-d66a-4bfb-92a6-6323606b7ed6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Lock "cinder-f0f6d194-4612-461e-8881-f7ed988fa9c1-delete_snapshot" released by "delete_snapshot" :: held 2.863s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b367c558-502e-418f-b3c2-83c447c0b531 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Acquiring lock "cinder-fa033634-8494-4a91-92f0-f50e03fffd4f-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b367c558-502e-418f-b3c2-83c447c0b531 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Lock "cinder-fa033634-8494-4a91-92f0-f50e03fffd4f-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:02 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b367c558-502e-418f-b3c2-83c447c0b531 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Acquiring lock "cinder-quobyte-fa033634-8494-4a91-92f0-f50e03fffd4f" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:02 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b367c558-502e-418f-b3c2-83c447c0b531 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Lock "cinder-quobyte-fa033634-8494-4a91-92f0-f50e03fffd4f" acquired by "delete_volume" :: waited 0.026s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:02 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d2fbc9-ed09-4209-9ef3-18d3b56fb69b]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b367c558-502e-418f-b3c2-83c447c0b531 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:02 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f Sep 28 18:12:02 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:02 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b367c558-502e-418f-b3c2-83c447c0b531 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f" returned: 0 in 0.580s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b367c558-502e-418f-b3c2-83c447c0b531 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:02 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f Sep 28 18:12:02 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:02 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_3mr7vo2tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-200d5605-a290-4143-8fab-fb14acf7097b" returned: 0 in 3.250s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:02 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_3mr7vo2tdevstack@QuobyteHD, size 112.00 MB, duration 3.25 sec, destination /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-200d5605-a290-4143-8fab-fb14acf7097b {{(pid=86980) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:12:02 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Converted 112.00 MB image at 34.45 MB/s Sep 28 18:12:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-200d5605-a290-4143-8fab-fb14acf7097b 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:02 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-200d5605-a290-4143-8fab-fb14acf7097b 1G Sep 28 18:12:02 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:03 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b367c558-502e-418f-b3c2-83c447c0b531 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa033634-8494-4a91-92f0-f50e03fffd4f" returned: 0 in 0.356s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:03 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b367c558-502e-418f-b3c2-83c447c0b531 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Lock "cinder-quobyte-fa033634-8494-4a91-92f0-f50e03fffd4f" released by "delete_volume" :: held 1.064s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:03 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-b367c558-502e-418f-b3c2-83c447c0b531 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Created reservations ['a3608d08-4c8a-47ad-a17a-99186107d525', 'e0842bea-0cb5-4e0d-98d8-8b8b5fa68c52', '0f5b29f1-4962-42eb-adc8-6210786730ae', '2f0c23d2-429b-43cd-81f1-df417dc36146'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:03 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-200d5605-a290-4143-8fab-fb14acf7097b 1G" returned: 0 in 0.525s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:03 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Downloaded image d5838d4d-ebb7-4d18-8c3c-fc660c294083 ((None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}])) to volume 200d5605-a290-4143-8fab-fb14acf7097b successfully. {{(pid=86980) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:12:03 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Temporary image d5838d4d-ebb7-4d18-8c3c-fc660c294083 for user 1e0f904a44b74d208fdd2f30799970d4 is deleted. {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:12:03 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Marking volume 200d5605-a290-4143-8fab-fb14acf7097b as bootable. {{(pid=86980) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:12:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b367c558-502e-418f-b3c2-83c447c0b531 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b367c558-502e-418f-b3c2-83c447c0b531 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b367c558-502e-418f-b3c2-83c447c0b531 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b367c558-502e-418f-b3c2-83c447c0b531 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b367c558-502e-418f-b3c2-83c447c0b531 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b367c558-502e-418f-b3c2-83c447c0b531 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:03 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Copying metadata from image d5838d4d-ebb7-4d18-8c3c-fc660c294083 to 200d5605-a290-4143-8fab-fb14acf7097b. {{(pid=86980) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:12:03 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Creating volume glance metadata for volume 200d5605-a290-4143-8fab-fb14acf7097b backed by image d5838d4d-ebb7-4d18-8c3c-fc660c294083 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86980) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:12:03 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:12:03 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f58b230-8af5-4cfe-9331-a8329b619249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-200d5605-a290-4143-8fab-fb14acf7097b', 'volume_size': 1, 'image_id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c13a4cea8f714bb0b9012709acb9372b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'created_at': datetime.datetime(2026, 9, 28, 15, 57, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 57, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e58235b-bc85-436b-8a69-e83ce1629e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:03 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Volume volume-200d5605-a290-4143-8fab-fb14acf7097b (200d5605-a290-4143-8fab-fb14acf7097b): created successfully Sep 28 18:12:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e58235b-bc85-436b-8a69-e83ce1629e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Flow 'volume_create_manager' (27adfc88-809a-4e93-800c-d277b088db33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:03 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-2a6bb636-8f57-4211-8c74-afa6993989e1 tempest-VolumesImageMetadata-1089674241 None] Created volume successfully. Sep 28 18:12:03 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b367c558-502e-418f-b3c2-83c447c0b531 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.350s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:03 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-b367c558-502e-418f-b3c2-83c447c0b531 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:03 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-b367c558-502e-418f-b3c2-83c447c0b531 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Deleted volume successfully. Sep 28 18:12:03 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b367c558-502e-418f-b3c2-83c447c0b531 tempest-VolumeSnapshotQuotasNegativeTestJSON-1845324528 None] Lock "cinder-fa033634-8494-4a91-92f0-f50e03fffd4f-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:12:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:04 devstack sudo[96562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:12:04 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:04 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:04 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Flow 'volume_create_manager' (de57fe61-f520-48bb-bb55-552a21ce24ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bb23ff0-4a92-4da1-b94e-f3dd2393f7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.435s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:04 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bb23ff0-4a92-4da1-b94e-f3dd2393f7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2042453263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee8148d-c6da-4c98-861f-fa4df80402b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c03bdc18e0d746288534add3a5f73c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:05Z,use_quota=True,user_id='4d4a7b71f77641b48c4dab6162592cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c965be2f-2993-43d5-b930-ad01cdeb8915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c965be2f-2993-43d5-b930-ad01cdeb8915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89dcda47-3227-42ad-8cc1-c857d1be53d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:05 devstack cinder-volume[86980]: DEBUG cinder.image.glance [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Creating Keystone auth plugin from conf {{(pid=86980) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:12:05 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager._thread_info {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:12:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread count: 28 {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:12:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread info: [<_MainThread(MainThread, started 129097393381504)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:12:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-309bc25b-d470-4d1e-bff5-04b0e6f34aee tempest-VolumesImageMetadata-1089674241 None] Acquiring lock "cinder-200d5605-a290-4143-8fab-fb14acf7097b-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-309bc25b-d470-4d1e-bff5-04b0e6f34aee tempest-VolumesImageMetadata-1089674241 None] Lock "cinder-200d5605-a290-4143-8fab-fb14acf7097b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-309bc25b-d470-4d1e-bff5-04b0e6f34aee tempest-VolumesImageMetadata-1089674241 None] Acquiring lock "cinder-quobyte-200d5605-a290-4143-8fab-fb14acf7097b" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-309bc25b-d470-4d1e-bff5-04b0e6f34aee tempest-VolumesImageMetadata-1089674241 None] Lock "cinder-quobyte-200d5605-a290-4143-8fab-fb14acf7097b" acquired by "delete_volume" :: waited 0.022s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:05 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e5cebe-46f2-4952-be8f-71197a380652]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-309bc25b-d470-4d1e-bff5-04b0e6f34aee tempest-VolumesImageMetadata-1089674241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-200d5605-a290-4143-8fab-fb14acf7097b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:05 devstack sudo[96565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-200d5605-a290-4143-8fab-fb14acf7097b Sep 28 18:12:05 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:06 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-309bc25b-d470-4d1e-bff5-04b0e6f34aee tempest-VolumesImageMetadata-1089674241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-200d5605-a290-4143-8fab-fb14acf7097b" returned: 0 in 0.560s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-309bc25b-d470-4d1e-bff5-04b0e6f34aee tempest-VolumesImageMetadata-1089674241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-200d5605-a290-4143-8fab-fb14acf7097b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:06 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-200d5605-a290-4143-8fab-fb14acf7097b Sep 28 18:12:06 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89dcda47-3227-42ad-8cc1-c857d1be53d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4ee8148d-c6da-4c98-861f-fa4df80402b4', 'volume_name': 'volume-4ee8148d-c6da-4c98-861f-fa4df80402b4', 'volume_size': 1, 'image_id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c13a4cea8f714bb0b9012709acb9372b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'created_at': datetime.datetime(2026, 9, 28, 15, 57, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 57, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e85f80-055a-4e7f-a7c0-c8afa0edf062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e85f80-055a-4e7f-a7c0-c8afa0edf062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa00af5b-a1ac-4b1a-b251-9d445155235d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:06 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Volume 4ee8148d-c6da-4c98-861f-fa4df80402b4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4ee8148d-c6da-4c98-861f-fa4df80402b4', 'volume_size': 1, 'image_id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c13a4cea8f714bb0b9012709acb9372b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'created_at': datetime.datetime(2026, 9, 28, 15, 57, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 57, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 18:12:06 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Trying to clone 4ee8148d-c6da-4c98-861f-fa4df80402b4 from image d5838d4d-ebb7-4d18-8c3c-fc660c294083 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}]). {{(pid=86980) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:12:06 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-309bc25b-d470-4d1e-bff5-04b0e6f34aee tempest-VolumesImageMetadata-1089674241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-200d5605-a290-4143-8fab-fb14acf7097b" returned: 0 in 0.397s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-309bc25b-d470-4d1e-bff5-04b0e6f34aee tempest-VolumesImageMetadata-1089674241 None] Lock "cinder-quobyte-200d5605-a290-4143-8fab-fb14acf7097b" released by "delete_volume" :: held 1.071s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:06 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-309bc25b-d470-4d1e-bff5-04b0e6f34aee tempest-VolumesImageMetadata-1089674241 None] Created reservations ['023f521c-027c-49d7-80dc-1ccab043a761', 'e87f0e95-08ef-4708-8b06-231727c274b9', 'c815d422-1352-4134-9222-79462ba645dd', 'bb0a4e6d-2539-48ae-8fe4-fd0b515872a3'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:06 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_i99yy5pudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:12:06 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Image download 20.69 MB at 20.69 MB/s Sep 28 18:12:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-309bc25b-d470-4d1e-bff5-04b0e6f34aee tempest-VolumesImageMetadata-1089674241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-309bc25b-d470-4d1e-bff5-04b0e6f34aee tempest-VolumesImageMetadata-1089674241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-309bc25b-d470-4d1e-bff5-04b0e6f34aee tempest-VolumesImageMetadata-1089674241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-309bc25b-d470-4d1e-bff5-04b0e6f34aee tempest-VolumesImageMetadata-1089674241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-309bc25b-d470-4d1e-bff5-04b0e6f34aee tempest-VolumesImageMetadata-1089674241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-309bc25b-d470-4d1e-bff5-04b0e6f34aee tempest-VolumesImageMetadata-1089674241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:07 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e839a663-1f8a-48bd-bd77-565a75d533c5]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_i99yy5pudevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:07 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:12:07 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:07 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_i99yy5pudevstack@QuobyteHD Sep 28 18:12:07 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:07 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-309bc25b-d470-4d1e-bff5-04b0e6f34aee tempest-VolumesImageMetadata-1089674241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.377s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:07 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-309bc25b-d470-4d1e-bff5-04b0e6f34aee tempest-VolumesImageMetadata-1089674241 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:07 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-309bc25b-d470-4d1e-bff5-04b0e6f34aee tempest-VolumesImageMetadata-1089674241 None] Deleted volume successfully. Sep 28 18:12:07 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-309bc25b-d470-4d1e-bff5-04b0e6f34aee tempest-VolumesImageMetadata-1089674241 None] Lock "cinder-200d5605-a290-4143-8fab-fb14acf7097b-delete_volume" released by "delete_volume" :: held 1.974s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:07 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_i99yy5pudevstack@QuobyteHD" returned: 0 in 0.473s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:07 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Temporary image d5838d4d-ebb7-4d18-8c3c-fc660c294083 is fetched for user 4d4a7b71f77641b48c4dab6162592cf9. {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:12:07 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[67274420-079c-4e8d-8a45-3b24c87e576e]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_i99yy5pudevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:07 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_i99yy5pudevstack@QuobyteHD Sep 28 18:12:07 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:08 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_i99yy5pudevstack@QuobyteHD" returned: 0 in 0.530s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:08 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2042453263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee8148d-c6da-4c98-861f-fa4df80402b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c03bdc18e0d746288534add3a5f73c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:05Z,use_quota=True,user_id='4d4a7b71f77641b48c4dab6162592cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:08 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Creating volume 4ee8148d-c6da-4c98-861f-fa4df80402b4 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:08 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:08 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:08 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:08 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:12:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4ee8148d-c6da-4c98-861f-fa4df80402b4 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:08 devstack sudo[96588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4ee8148d-c6da-4c98-861f-fa4df80402b4 1073741824 Sep 28 18:12:08 devstack sudo[96588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:08 devstack sudo[96588]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4ee8148d-c6da-4c98-861f-fa4df80402b4 1073741824" returned: 0 in 0.723s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4ee8148d-c6da-4c98-861f-fa4df80402b4 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:08 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4ee8148d-c6da-4c98-861f-fa4df80402b4 Sep 28 18:12:08 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:09 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4ee8148d-c6da-4c98-861f-fa4df80402b4" returned: 0 in 0.324s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:09 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Attempting download of d5838d4d-ebb7-4d18-8c3c-fc660c294083 ((None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}])) to volume 4ee8148d-c6da-4c98-861f-fa4df80402b4. {{(pid=86980) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:12:09 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd7ae99-541a-4a12-9acf-c16d32ffbe9e]: (4, 'raw') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ksq9er26 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:09 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ksq9er26 Sep 28 18:12:09 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:09 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ksq9er26" returned: 0 in 0.400s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ksq9er26 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:09 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ksq9er26 Sep 28 18:12:09 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:10 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ksq9er26" returned: 1 in 0.408s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ksq9er26' failed. Not Retrying. {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:12:10 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[507a4ee7-908e-4159-b784-4f217c9eb56d]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_i99yy5pudevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:10 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_i99yy5pudevstack@QuobyteHD Sep 28 18:12:10 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:10 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_i99yy5pudevstack@QuobyteHD" returned: 0 in 0.631s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:10 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] d5838d4d-ebb7-4d18-8c3c-fc660c294083 was qcow2, converting to qcow2 {{(pid=86980) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:12:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_i99yy5pudevstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4ee8148d-c6da-4c98-861f-fa4df80402b4 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:10 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_i99yy5pudevstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4ee8148d-c6da-4c98-861f-fa4df80402b4 Sep 28 18:12:10 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:13 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_i99yy5pudevstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4ee8148d-c6da-4c98-861f-fa4df80402b4" returned: 0 in 2.883s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:13 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_i99yy5pudevstack@QuobyteHD, size 112.00 MB, duration 2.89 sec, destination /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4ee8148d-c6da-4c98-861f-fa4df80402b4 {{(pid=86980) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:12:13 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Converted 112.00 MB image at 38.82 MB/s Sep 28 18:12:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4ee8148d-c6da-4c98-861f-fa4df80402b4 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:13 devstack sudo[96620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4ee8148d-c6da-4c98-861f-fa4df80402b4 1G Sep 28 18:12:13 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:14 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4ee8148d-c6da-4c98-861f-fa4df80402b4 1G" returned: 0 in 0.479s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:14 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Downloaded image d5838d4d-ebb7-4d18-8c3c-fc660c294083 ((None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}])) to volume 4ee8148d-c6da-4c98-861f-fa4df80402b4 successfully. {{(pid=86980) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:12:14 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Temporary image d5838d4d-ebb7-4d18-8c3c-fc660c294083 for user 4d4a7b71f77641b48c4dab6162592cf9 is deleted. {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:12:14 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Marking volume 4ee8148d-c6da-4c98-861f-fa4df80402b4 as bootable. {{(pid=86980) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:12:14 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Copying metadata from image d5838d4d-ebb7-4d18-8c3c-fc660c294083 to 4ee8148d-c6da-4c98-861f-fa4df80402b4. {{(pid=86980) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:12:14 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Creating volume glance metadata for volume 4ee8148d-c6da-4c98-861f-fa4df80402b4 backed by image d5838d4d-ebb7-4d18-8c3c-fc660c294083 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86980) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:12:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa00af5b-a1ac-4b1a-b251-9d445155235d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ee8148d-c6da-4c98-861f-fa4df80402b4', 'volume_size': 1, 'image_id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c13a4cea8f714bb0b9012709acb9372b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'created_at': datetime.datetime(2026, 9, 28, 15, 57, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 57, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7825de48-b170-4ec3-91f7-d97a7283b30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:14 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Volume volume-4ee8148d-c6da-4c98-861f-fa4df80402b4 (4ee8148d-c6da-4c98-861f-fa4df80402b4): created successfully Sep 28 18:12:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7825de48-b170-4ec3-91f7-d97a7283b30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Flow 'volume_create_manager' (de57fe61-f520-48bb-bb55-552a21ce24ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:14 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-4baac6b3-63f6-4cd3-b71b-c29bb9a70e5a tempest-VolumesExtendTest-1493988835 None] Created volume successfully. Sep 28 18:12:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3c732ac7-7adc-4f60-9a93-670b01e1c5ff tempest-VolumesExtendTest-1493988835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3c732ac7-7adc-4f60-9a93-670b01e1c5ff tempest-VolumesExtendTest-1493988835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:15 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf9f5d4-b866-4189-add6-9a1d4b1d0030]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3c732ac7-7adc-4f60-9a93-670b01e1c5ff tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4ee8148d-c6da-4c98-861f-fa4df80402b4 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:15 devstack sudo[96626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4ee8148d-c6da-4c98-861f-fa4df80402b4 Sep 28 18:12:15 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:15 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3c732ac7-7adc-4f60-9a93-670b01e1c5ff tempest-VolumesExtendTest-1493988835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4ee8148d-c6da-4c98-861f-fa4df80402b4" returned: 0 in 0.579s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3c732ac7-7adc-4f60-9a93-670b01e1c5ff tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4ee8148d-c6da-4c98-861f-fa4df80402b4 2G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3c732ac7-7adc-4f60-9a93-670b01e1c5ff tempest-VolumesExtendTest-1493988835 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4ee8148d-c6da-4c98-861f-fa4df80402b4 2G" returned: 0 in 0.187s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3c732ac7-7adc-4f60-9a93-670b01e1c5ff tempest-VolumesExtendTest-1493988835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.800s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:15 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-3c732ac7-7adc-4f60-9a93-670b01e1c5ff tempest-VolumesExtendTest-1493988835 None] Extend volume completed successfully. Sep 28 18:12:15 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Flow 'volume_create_manager' (4c76f715-f8b9-412a-8f06-a387693fec65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa365eae-65f4-4637-b435-551337bb7e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa365eae-65f4-4637-b435-551337bb7e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-77139552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb7b7b8c-26ab-4a9b-b27e-83bd782bb01a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f446948d0946b998338baa8941f3cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:16Z,use_quota=True,user_id='aba41c5533c04067807aad4d33bfa122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af65de92-0ad7-41bc-93d6-1d18c039d521),volume_type_id=af65de92-0ad7-41bc-93d6-1d18c039d521)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d732341-b608-4925-95dc-3c0f1f5923e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d732341-b608-4925-95dc-3c0f1f5923e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62dbc869-3aae-4cb8-9446-9f99bedd329f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62dbc869-3aae-4cb8-9446-9f99bedd329f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb7b7b8c-26ab-4a9b-b27e-83bd782bb01a', 'volume_name': 'volume-bb7b7b8c-26ab-4a9b-b27e-83bd782bb01a', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa71f220-19b8-4d7f-863c-d9bc0cd65d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa71f220-19b8-4d7f-863c-d9bc0cd65d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8559b4cd-7438-4ea4-b7fe-a7ad001ec9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:16 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Volume bb7b7b8c-26ab-4a9b-b27e-83bd782bb01a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb7b7b8c-26ab-4a9b-b27e-83bd782bb01a', 'volume_size': 1} Sep 28 18:12:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-77139552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb7b7b8c-26ab-4a9b-b27e-83bd782bb01a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f446948d0946b998338baa8941f3cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:16Z,use_quota=True,user_id='aba41c5533c04067807aad4d33bfa122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af65de92-0ad7-41bc-93d6-1d18c039d521),volume_type_id=af65de92-0ad7-41bc-93d6-1d18c039d521)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Creating volume bb7b7b8c-26ab-4a9b-b27e-83bd782bb01a {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:16 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:12:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bb7b7b8c-26ab-4a9b-b27e-83bd782bb01a 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:16 devstack sudo[96635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bb7b7b8c-26ab-4a9b-b27e-83bd782bb01a 1073741824 Sep 28 18:12:16 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:16 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1d5133ff-7674-4eac-8100-5f88e88c79c0 tempest-VolumesExtendTest-1493988835 None] Acquiring lock "cinder-4ee8148d-c6da-4c98-861f-fa4df80402b4-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:16 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1d5133ff-7674-4eac-8100-5f88e88c79c0 tempest-VolumesExtendTest-1493988835 None] Lock "cinder-4ee8148d-c6da-4c98-861f-fa4df80402b4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:16 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1d5133ff-7674-4eac-8100-5f88e88c79c0 tempest-VolumesExtendTest-1493988835 None] Acquiring lock "cinder-quobyte-4ee8148d-c6da-4c98-861f-fa4df80402b4" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:16 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bb7b7b8c-26ab-4a9b-b27e-83bd782bb01a 1073741824" returned: 0 in 0.824s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:16 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1d5133ff-7674-4eac-8100-5f88e88c79c0 tempest-VolumesExtendTest-1493988835 None] Lock "cinder-quobyte-4ee8148d-c6da-4c98-861f-fa4df80402b4" acquired by "delete_volume" :: waited 0.042s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:16 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f69c4d-0073-4c9a-baf6-5aba1bb5f69b]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1d5133ff-7674-4eac-8100-5f88e88c79c0 tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4ee8148d-c6da-4c98-861f-fa4df80402b4 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bb7b7b8c-26ab-4a9b-b27e-83bd782bb01a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:17 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bb7b7b8c-26ab-4a9b-b27e-83bd782bb01a Sep 28 18:12:17 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:17 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4ee8148d-c6da-4c98-861f-fa4df80402b4 Sep 28 18:12:17 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:17 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bb7b7b8c-26ab-4a9b-b27e-83bd782bb01a" returned: 0 in 0.346s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:17 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:17 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8559b4cd-7438-4ea4-b7fe-a7ad001ec9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb7b7b8c-26ab-4a9b-b27e-83bd782bb01a', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:17 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dbe179a-8c2f-401e-9697-49b72a461ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:17 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Volume volume-bb7b7b8c-26ab-4a9b-b27e-83bd782bb01a (bb7b7b8c-26ab-4a9b-b27e-83bd782bb01a): created successfully Sep 28 18:12:17 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dbe179a-8c2f-401e-9697-49b72a461ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:17 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Flow 'volume_create_manager' (4c76f715-f8b9-412a-8f06-a387693fec65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:17 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-89216a68-dd8a-4472-9b92-ece7ec0f8a0c tempest-VolumeTypesAccessTest-1705779048 None] Created volume successfully. Sep 28 18:12:17 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1d5133ff-7674-4eac-8100-5f88e88c79c0 tempest-VolumesExtendTest-1493988835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4ee8148d-c6da-4c98-861f-fa4df80402b4" returned: 0 in 0.558s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1d5133ff-7674-4eac-8100-5f88e88c79c0 tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4ee8148d-c6da-4c98-861f-fa4df80402b4 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:17 devstack sudo[96648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4ee8148d-c6da-4c98-861f-fa4df80402b4 Sep 28 18:12:17 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:17 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1d5133ff-7674-4eac-8100-5f88e88c79c0 tempest-VolumesExtendTest-1493988835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4ee8148d-c6da-4c98-861f-fa4df80402b4" returned: 0 in 0.364s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:17 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1d5133ff-7674-4eac-8100-5f88e88c79c0 tempest-VolumesExtendTest-1493988835 None] Lock "cinder-quobyte-4ee8148d-c6da-4c98-861f-fa4df80402b4" released by "delete_volume" :: held 0.987s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:18 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-1d5133ff-7674-4eac-8100-5f88e88c79c0 tempest-VolumesExtendTest-1493988835 None] Created reservations ['d2bef6db-c5da-4eb5-a160-0c2e8ccd5b0c', 'ba450286-7834-4cc8-ba90-83cc13267e15', '40642885-ecbc-471f-b718-327d9b95c22c', 'e6632e2a-86de-49f6-a742-3f3afdf5e38c'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1d5133ff-7674-4eac-8100-5f88e88c79c0 tempest-VolumesExtendTest-1493988835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1d5133ff-7674-4eac-8100-5f88e88c79c0 tempest-VolumesExtendTest-1493988835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1d5133ff-7674-4eac-8100-5f88e88c79c0 tempest-VolumesExtendTest-1493988835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1d5133ff-7674-4eac-8100-5f88e88c79c0 tempest-VolumesExtendTest-1493988835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1d5133ff-7674-4eac-8100-5f88e88c79c0 tempest-VolumesExtendTest-1493988835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1d5133ff-7674-4eac-8100-5f88e88c79c0 tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:18 devstack sudo[96651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:12:18 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b0185f51-981c-4902-84b6-c1fb40eaa9bf tempest-VolumeTypesAccessTest-1705779048 None] Acquiring lock "cinder-bb7b7b8c-26ab-4a9b-b27e-83bd782bb01a-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b0185f51-981c-4902-84b6-c1fb40eaa9bf tempest-VolumeTypesAccessTest-1705779048 None] Lock "cinder-bb7b7b8c-26ab-4a9b-b27e-83bd782bb01a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b0185f51-981c-4902-84b6-c1fb40eaa9bf tempest-VolumeTypesAccessTest-1705779048 None] Acquiring lock "cinder-quobyte-bb7b7b8c-26ab-4a9b-b27e-83bd782bb01a" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b0185f51-981c-4902-84b6-c1fb40eaa9bf tempest-VolumeTypesAccessTest-1705779048 None] Lock "cinder-quobyte-bb7b7b8c-26ab-4a9b-b27e-83bd782bb01a" acquired by "delete_volume" :: waited 0.027s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:18 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[225b1d3a-195e-47a5-8f77-1870cb1b9c14]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b0185f51-981c-4902-84b6-c1fb40eaa9bf tempest-VolumeTypesAccessTest-1705779048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bb7b7b8c-26ab-4a9b-b27e-83bd782bb01a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:18 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1d5133ff-7674-4eac-8100-5f88e88c79c0 tempest-VolumesExtendTest-1493988835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.514s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:18 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-1d5133ff-7674-4eac-8100-5f88e88c79c0 tempest-VolumesExtendTest-1493988835 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:18 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-1d5133ff-7674-4eac-8100-5f88e88c79c0 tempest-VolumesExtendTest-1493988835 None] Deleted volume successfully. Sep 28 18:12:18 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bb7b7b8c-26ab-4a9b-b27e-83bd782bb01a Sep 28 18:12:18 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1d5133ff-7674-4eac-8100-5f88e88c79c0 tempest-VolumesExtendTest-1493988835 None] Lock "cinder-4ee8148d-c6da-4c98-861f-fa4df80402b4-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:19 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b0185f51-981c-4902-84b6-c1fb40eaa9bf tempest-VolumeTypesAccessTest-1705779048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bb7b7b8c-26ab-4a9b-b27e-83bd782bb01a" returned: 0 in 0.611s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b0185f51-981c-4902-84b6-c1fb40eaa9bf tempest-VolumeTypesAccessTest-1705779048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bb7b7b8c-26ab-4a9b-b27e-83bd782bb01a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:19 devstack sudo[96659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bb7b7b8c-26ab-4a9b-b27e-83bd782bb01a Sep 28 18:12:19 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:19 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b0185f51-981c-4902-84b6-c1fb40eaa9bf tempest-VolumeTypesAccessTest-1705779048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bb7b7b8c-26ab-4a9b-b27e-83bd782bb01a" returned: 0 in 0.484s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:19 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b0185f51-981c-4902-84b6-c1fb40eaa9bf tempest-VolumeTypesAccessTest-1705779048 None] Lock "cinder-quobyte-bb7b7b8c-26ab-4a9b-b27e-83bd782bb01a" released by "delete_volume" :: held 1.191s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:19 devstack cinder-volume[86980]: WARNING cinder.quota [None req-b0185f51-981c-4902-84b6-c1fb40eaa9bf tempest-VolumeTypesAccessTest-1705779048 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1004168584 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1004168584, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:12:19 devstack cinder-volume[86980]: WARNING cinder.quota [None req-b0185f51-981c-4902-84b6-c1fb40eaa9bf tempest-VolumeTypesAccessTest-1705779048 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1004168584 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1004168584, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:12:19 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-b0185f51-981c-4902-84b6-c1fb40eaa9bf tempest-VolumeTypesAccessTest-1705779048 None] Created reservations ['c92cfed2-d8c8-4e6a-bbfb-12128609483d', 'f0d594fe-a870-409f-bf29-e5802c3e6691', '79993033-744a-43ed-9020-2c4196ac4def', '4233dc7d-e626-44c2-8422-00451206f65c'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b0185f51-981c-4902-84b6-c1fb40eaa9bf tempest-VolumeTypesAccessTest-1705779048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b0185f51-981c-4902-84b6-c1fb40eaa9bf tempest-VolumeTypesAccessTest-1705779048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b0185f51-981c-4902-84b6-c1fb40eaa9bf tempest-VolumeTypesAccessTest-1705779048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b0185f51-981c-4902-84b6-c1fb40eaa9bf tempest-VolumeTypesAccessTest-1705779048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b0185f51-981c-4902-84b6-c1fb40eaa9bf tempest-VolumeTypesAccessTest-1705779048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b0185f51-981c-4902-84b6-c1fb40eaa9bf tempest-VolumeTypesAccessTest-1705779048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:20 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:12:20 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:20 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Flow 'volume_create_manager' (633d505c-d2b0-4dd1-b7ec-a9a41c9ec584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ecf10cc-fa96-4c1b-ac22-4e4fa4b07b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ecf10cc-fa96-4c1b-ac22-4e4fa4b07b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1805354088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52c5473e-d235-4395-a6df-5e2f14467e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c03bdc18e0d746288534add3a5f73c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:20Z,use_quota=True,user_id='4d4a7b71f77641b48c4dab6162592cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ea5016-a41e-41e1-89d4-f5eb29d07d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ea5016-a41e-41e1-89d4-f5eb29d07d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d2f8697-ba59-4ba0-91c3-83703a44c8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d2f8697-ba59-4ba0-91c3-83703a44c8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52c5473e-d235-4395-a6df-5e2f14467e5b', 'volume_name': 'volume-52c5473e-d235-4395-a6df-5e2f14467e5b', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e26f12-09f0-4d30-98d3-e5202f1647f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e26f12-09f0-4d30-98d3-e5202f1647f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4469c703-81be-4bc3-9ee0-db497217760c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:20 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Volume 52c5473e-d235-4395-a6df-5e2f14467e5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52c5473e-d235-4395-a6df-5e2f14467e5b', 'volume_size': 1} Sep 28 18:12:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:20 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1805354088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52c5473e-d235-4395-a6df-5e2f14467e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c03bdc18e0d746288534add3a5f73c72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:20Z,use_quota=True,user_id='4d4a7b71f77641b48c4dab6162592cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:20 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Creating volume 52c5473e-d235-4395-a6df-5e2f14467e5b {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:20 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:20 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:20 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:20 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:12:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:20 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b0185f51-981c-4902-84b6-c1fb40eaa9bf tempest-VolumeTypesAccessTest-1705779048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.623s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:20 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-b0185f51-981c-4902-84b6-c1fb40eaa9bf tempest-VolumeTypesAccessTest-1705779048 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:20 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-b0185f51-981c-4902-84b6-c1fb40eaa9bf tempest-VolumeTypesAccessTest-1705779048 None] Deleted volume successfully. Sep 28 18:12:20 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b 1073741824 Sep 28 18:12:20 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:20 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b0185f51-981c-4902-84b6-c1fb40eaa9bf tempest-VolumeTypesAccessTest-1705779048 None] Lock "cinder-bb7b7b8c-26ab-4a9b-b27e-83bd782bb01a-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:21 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b 1073741824" returned: 0 in 1.045s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:21 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b Sep 28 18:12:21 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:22 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b" returned: 0 in 0.497s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:22 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4469c703-81be-4bc3-9ee0-db497217760c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52c5473e-d235-4395-a6df-5e2f14467e5b', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf177fb8-e8e2-4f34-9e2e-b462aa977f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:22 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Volume volume-52c5473e-d235-4395-a6df-5e2f14467e5b (52c5473e-d235-4395-a6df-5e2f14467e5b): created successfully Sep 28 18:12:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf177fb8-e8e2-4f34-9e2e-b462aa977f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Flow 'volume_create_manager' (633d505c-d2b0-4dd1-b7ec-a9a41c9ec584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:22 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-c9102181-68e0-4bd6-9e30-5ba1ee32cdce tempest-VolumesExtendTest-1493988835 None] Created volume successfully. Sep 28 18:12:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-44536e41-74b2-4c50-8042-366325fdb4dd tempest-VolumesExtendTest-1493988835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-44536e41-74b2-4c50-8042-366325fdb4dd tempest-VolumesExtendTest-1493988835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-44536e41-74b2-4c50-8042-366325fdb4dd tempest-VolumesExtendTest-1493988835 None] Creating offline snapshot add8c71f-db82-473a-9357-f487aaf11c01 of volume 52c5473e-d235-4395-a6df-5e2f14467e5b {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:12:23 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab3d7b7-d2c4-4272-9290-dbf700ff9efa]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-44536e41-74b2-4c50-8042-366325fdb4dd tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:24 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b Sep 28 18:12:24 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:24 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-44536e41-74b2-4c50-8042-366325fdb4dd tempest-VolumesExtendTest-1493988835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b" returned: 0 in 0.661s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-44536e41-74b2-4c50-8042-366325fdb4dd tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b.add8c71f-db82-473a-9357-f487aaf11c01 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:24 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b.add8c71f-db82-473a-9357-f487aaf11c01 1G Sep 28 18:12:24 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:24 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Flow 'volume_create_manager' (cfda108f-d845-4894-8d55-d583eabea42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5918ae3-eb92-4522-9dfb-f3c2550c6c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5918ae3-eb92-4522-9dfb-f3c2550c6c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1301983843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e227c8ab-3912-4a4a-ab5e-5a6b613679a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6030df6f55c4084a89890360251eedb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:25Z,use_quota=True,user_id='249976cebca946349a98e1a6a5e946fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (409f693b-cafa-4ae9-8f5d-62872eb2aba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (409f693b-cafa-4ae9-8f5d-62872eb2aba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f9be1f4-d00b-4dfe-b485-0f448e85c07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f9be1f4-d00b-4dfe-b485-0f448e85c07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e227c8ab-3912-4a4a-ab5e-5a6b613679a4', 'volume_name': 'volume-e227c8ab-3912-4a4a-ab5e-5a6b613679a4', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d70e3dd-af57-46fe-ab0d-31781cd9e86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d70e3dd-af57-46fe-ab0d-31781cd9e86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a09f689-00cb-4e52-a42f-67dcae25d56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:25 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Volume e227c8ab-3912-4a4a-ab5e-5a6b613679a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e227c8ab-3912-4a4a-ab5e-5a6b613679a4', 'volume_size': 1} Sep 28 18:12:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:25 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-44536e41-74b2-4c50-8042-366325fdb4dd tempest-VolumesExtendTest-1493988835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b.add8c71f-db82-473a-9357-f487aaf11c01 1G" returned: 0 in 0.642s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-44536e41-74b2-4c50-8042-366325fdb4dd tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52c5473e-d235-4395-a6df-5e2f14467e5b -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b.add8c71f-db82-473a-9357-f487aaf11c01 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:25 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52c5473e-d235-4395-a6df-5e2f14467e5b -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b.add8c71f-db82-473a-9357-f487aaf11c01 Sep 28 18:12:25 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:25 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-44536e41-74b2-4c50-8042-366325fdb4dd tempest-VolumesExtendTest-1493988835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52c5473e-d235-4395-a6df-5e2f14467e5b -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b.add8c71f-db82-473a-9357-f487aaf11c01" returned: 0 in 0.379s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:25 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-44536e41-74b2-4c50-8042-366325fdb4dd tempest-VolumesExtendTest-1493988835 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b.add8c71f-db82-473a-9357-f487aaf11c01 is being set with open permissions: ugo+rw Sep 28 18:12:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-44536e41-74b2-4c50-8042-366325fdb4dd tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b.add8c71f-db82-473a-9357-f487aaf11c01 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:25 devstack sudo[96694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b.add8c71f-db82-473a-9357-f487aaf11c01 Sep 28 18:12:25 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:26 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-44536e41-74b2-4c50-8042-366325fdb4dd tempest-VolumesExtendTest-1493988835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b.add8c71f-db82-473a-9357-f487aaf11c01" returned: 0 in 0.396s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-44536e41-74b2-4c50-8042-366325fdb4dd tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:26 devstack sudo[96697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b.info Sep 28 18:12:26 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:26 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-44536e41-74b2-4c50-8042-366325fdb4dd tempest-VolumesExtendTest-1493988835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b.info" returned: 0 in 0.395s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:26 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-44536e41-74b2-4c50-8042-366325fdb4dd tempest-VolumesExtendTest-1493988835 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b.info is being set with open permissions: ugo+rw Sep 28 18:12:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-44536e41-74b2-4c50-8042-366325fdb4dd tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:26 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b.info Sep 28 18:12:26 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:26 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-44536e41-74b2-4c50-8042-366325fdb4dd tempest-VolumesExtendTest-1493988835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b.info" returned: 0 in 0.293s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-44536e41-74b2-4c50-8042-366325fdb4dd tempest-VolumesExtendTest-1493988835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.984s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.729s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:26 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1301983843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e227c8ab-3912-4a4a-ab5e-5a6b613679a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6030df6f55c4084a89890360251eedb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:25Z,use_quota=True,user_id='249976cebca946349a98e1a6a5e946fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:26 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Creating volume e227c8ab-3912-4a4a-ab5e-5a6b613679a4 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:26 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:26 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:26 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:26 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:12:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e227c8ab-3912-4a4a-ab5e-5a6b613679a4 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:26 devstack sudo[96703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e227c8ab-3912-4a4a-ab5e-5a6b613679a4 1073741824 Sep 28 18:12:26 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:26 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-44536e41-74b2-4c50-8042-366325fdb4dd tempest-VolumesExtendTest-1493988835 None] Create snapshot completed successfully Sep 28 18:12:27 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e227c8ab-3912-4a4a-ab5e-5a6b613679a4 1073741824" returned: 0 in 0.792s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e227c8ab-3912-4a4a-ab5e-5a6b613679a4 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:27 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e227c8ab-3912-4a4a-ab5e-5a6b613679a4 Sep 28 18:12:27 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:28 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e227c8ab-3912-4a4a-ab5e-5a6b613679a4" returned: 0 in 0.364s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:28 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a09f689-00cb-4e52-a42f-67dcae25d56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e227c8ab-3912-4a4a-ab5e-5a6b613679a4', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab7e4bf0-f01b-4c4d-a264-bc1fce48199b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:28 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Volume volume-e227c8ab-3912-4a4a-ab5e-5a6b613679a4 (e227c8ab-3912-4a4a-ab5e-5a6b613679a4): created successfully Sep 28 18:12:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab7e4bf0-f01b-4c4d-a264-bc1fce48199b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Flow 'volume_create_manager' (cfda108f-d845-4894-8d55-d583eabea42f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:28 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-8b4eb89d-752f-497b-b710-2ca379d6193d tempest-AbsoluteLimitsTests-1916861899 None] Created volume successfully. Sep 28 18:12:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1fbb6da5-60de-44ff-8002-ec0c304a236d tempest-VolumesExtendTest-1493988835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1fbb6da5-60de-44ff-8002-ec0c304a236d tempest-VolumesExtendTest-1493988835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:28 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8daea8-176d-4238-ba36-a14d8510fb48]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1fbb6da5-60de-44ff-8002-ec0c304a236d tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:28 devstack sudo[96715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b Sep 28 18:12:28 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:28 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1fbb6da5-60de-44ff-8002-ec0c304a236d tempest-VolumesExtendTest-1493988835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b" returned: 0 in 0.540s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1fbb6da5-60de-44ff-8002-ec0c304a236d tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b.add8c71f-db82-473a-9357-f487aaf11c01 2G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1fbb6da5-60de-44ff-8002-ec0c304a236d tempest-VolumesExtendTest-1493988835 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b.add8c71f-db82-473a-9357-f487aaf11c01 2G" returned: 0 in 0.228s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1fbb6da5-60de-44ff-8002-ec0c304a236d tempest-VolumesExtendTest-1493988835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.820s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:29 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-1fbb6da5-60de-44ff-8002-ec0c304a236d tempest-VolumesExtendTest-1493988835 None] Extend volume completed successfully. Sep 28 18:12:29 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fb958db9-f646-4016-b0d2-a985fc395d3a tempest-VolumesExtendTest-1493988835 None] Acquiring lock "cinder-add8c71f-db82-473a-9357-f487aaf11c01-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:29 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fb958db9-f646-4016-b0d2-a985fc395d3a tempest-VolumesExtendTest-1493988835 None] Lock "cinder-add8c71f-db82-473a-9357-f487aaf11c01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:29 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fb958db9-f646-4016-b0d2-a985fc395d3a tempest-VolumesExtendTest-1493988835 None] Acquiring lock "cinder-quobyte-52c5473e-d235-4395-a6df-5e2f14467e5b" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:29 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fb958db9-f646-4016-b0d2-a985fc395d3a tempest-VolumesExtendTest-1493988835 None] Lock "cinder-quobyte-52c5473e-d235-4395-a6df-5e2f14467e5b" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:29 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fb958db9-f646-4016-b0d2-a985fc395d3a tempest-VolumesExtendTest-1493988835 None] Acquiring lock "cinder-quobyte-add8c71f-db82-473a-9357-f487aaf11c01" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:29 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fb958db9-f646-4016-b0d2-a985fc395d3a tempest-VolumesExtendTest-1493988835 None] Lock "cinder-quobyte-add8c71f-db82-473a-9357-f487aaf11c01" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-fb958db9-f646-4016-b0d2-a985fc395d3a tempest-VolumesExtendTest-1493988835 None] Deleting offline snapshot add8c71f-db82-473a-9357-f487aaf11c01 of volume 52c5473e-d235-4395-a6df-5e2f14467e5b {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:12:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-fb958db9-f646-4016-b0d2-a985fc395d3a tempest-VolumesExtendTest-1493988835 None] snapshot_file for this snap is: volume-52c5473e-d235-4395-a6df-5e2f14467e5b.add8c71f-db82-473a-9357-f487aaf11c01 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:12:29 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8061137b-c86b-4323-b9ce-115668d37e20]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fb958db9-f646-4016-b0d2-a985fc395d3a tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b.add8c71f-db82-473a-9357-f487aaf11c01 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:30 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b.add8c71f-db82-473a-9357-f487aaf11c01 Sep 28 18:12:30 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:30 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ffa0af54-d68e-41ed-9f87-d6861cb10925 tempest-AbsoluteLimitsTests-1916861899 None] Acquiring lock "cinder-e227c8ab-3912-4a4a-ab5e-5a6b613679a4-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:30 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ffa0af54-d68e-41ed-9f87-d6861cb10925 tempest-AbsoluteLimitsTests-1916861899 None] Lock "cinder-e227c8ab-3912-4a4a-ab5e-5a6b613679a4-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:30 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ffa0af54-d68e-41ed-9f87-d6861cb10925 tempest-AbsoluteLimitsTests-1916861899 None] Acquiring lock "cinder-quobyte-e227c8ab-3912-4a4a-ab5e-5a6b613679a4" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:30 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ffa0af54-d68e-41ed-9f87-d6861cb10925 tempest-AbsoluteLimitsTests-1916861899 None] Lock "cinder-quobyte-e227c8ab-3912-4a4a-ab5e-5a6b613679a4" acquired by "delete_volume" :: waited 0.046s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:30 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcab6d9-1217-47c7-89be-5f6dbca63069]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ffa0af54-d68e-41ed-9f87-d6861cb10925 tempest-AbsoluteLimitsTests-1916861899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e227c8ab-3912-4a4a-ab5e-5a6b613679a4 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:30 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e227c8ab-3912-4a4a-ab5e-5a6b613679a4 Sep 28 18:12:30 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:30 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fb958db9-f646-4016-b0d2-a985fc395d3a tempest-VolumesExtendTest-1493988835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b.add8c71f-db82-473a-9357-f487aaf11c01" returned: 0 in 0.852s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:30 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-fb958db9-f646-4016-b0d2-a985fc395d3a tempest-VolumesExtendTest-1493988835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52c5473e-d235-4395-a6df-5e2f14467e5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:12:30 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[195b6235-314d-42df-9ad5-8e9d813d9307]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fb958db9-f646-4016-b0d2-a985fc395d3a tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:31 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b Sep 28 18:12:31 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:31 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ffa0af54-d68e-41ed-9f87-d6861cb10925 tempest-AbsoluteLimitsTests-1916861899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e227c8ab-3912-4a4a-ab5e-5a6b613679a4" returned: 0 in 0.662s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ffa0af54-d68e-41ed-9f87-d6861cb10925 tempest-AbsoluteLimitsTests-1916861899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e227c8ab-3912-4a4a-ab5e-5a6b613679a4 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:31 devstack sudo[96752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e227c8ab-3912-4a4a-ab5e-5a6b613679a4 Sep 28 18:12:31 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:31 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fb958db9-f646-4016-b0d2-a985fc395d3a tempest-VolumesExtendTest-1493988835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b" returned: 0 in 0.634s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fb958db9-f646-4016-b0d2-a985fc395d3a tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b.add8c71f-db82-473a-9357-f487aaf11c01 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:31 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b.add8c71f-db82-473a-9357-f487aaf11c01 Sep 28 18:12:31 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:31 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ffa0af54-d68e-41ed-9f87-d6861cb10925 tempest-AbsoluteLimitsTests-1916861899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e227c8ab-3912-4a4a-ab5e-5a6b613679a4" returned: 0 in 0.357s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:31 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ffa0af54-d68e-41ed-9f87-d6861cb10925 tempest-AbsoluteLimitsTests-1916861899 None] Lock "cinder-quobyte-e227c8ab-3912-4a4a-ab5e-5a6b613679a4" released by "delete_volume" :: held 1.079s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:31 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-ffa0af54-d68e-41ed-9f87-d6861cb10925 tempest-AbsoluteLimitsTests-1916861899 None] Created reservations ['2baefe41-4eef-440d-bde3-ecc30a1f74fb', '4bb0a9f3-4cce-4ae3-865b-896c4fe766db', 'fe353c9c-9df4-41dc-a7af-c4fbd5c05c3f', '1934c9ce-c84f-49b9-bf20-7f2351082884'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ffa0af54-d68e-41ed-9f87-d6861cb10925 tempest-AbsoluteLimitsTests-1916861899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ffa0af54-d68e-41ed-9f87-d6861cb10925 tempest-AbsoluteLimitsTests-1916861899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:31 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ffa0af54-d68e-41ed-9f87-d6861cb10925 tempest-AbsoluteLimitsTests-1916861899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:31 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ffa0af54-d68e-41ed-9f87-d6861cb10925 tempest-AbsoluteLimitsTests-1916861899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ffa0af54-d68e-41ed-9f87-d6861cb10925 tempest-AbsoluteLimitsTests-1916861899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ffa0af54-d68e-41ed-9f87-d6861cb10925 tempest-AbsoluteLimitsTests-1916861899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:31 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:12:31 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:32 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fb958db9-f646-4016-b0d2-a985fc395d3a tempest-VolumesExtendTest-1493988835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b.add8c71f-db82-473a-9357-f487aaf11c01" returned: 0 in 0.629s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fb958db9-f646-4016-b0d2-a985fc395d3a tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b.add8c71f-db82-473a-9357-f487aaf11c01 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:32 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b.add8c71f-db82-473a-9357-f487aaf11c01 Sep 28 18:12:32 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:32 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ffa0af54-d68e-41ed-9f87-d6861cb10925 tempest-AbsoluteLimitsTests-1916861899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.373s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:32 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-ffa0af54-d68e-41ed-9f87-d6861cb10925 tempest-AbsoluteLimitsTests-1916861899 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:32 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-ffa0af54-d68e-41ed-9f87-d6861cb10925 tempest-AbsoluteLimitsTests-1916861899 None] Deleted volume successfully. Sep 28 18:12:32 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ffa0af54-d68e-41ed-9f87-d6861cb10925 tempest-AbsoluteLimitsTests-1916861899 None] Lock "cinder-e227c8ab-3912-4a4a-ab5e-5a6b613679a4-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:32 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fb958db9-f646-4016-b0d2-a985fc395d3a tempest-VolumesExtendTest-1493988835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b.add8c71f-db82-473a-9357-f487aaf11c01" returned: 0 in 0.376s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:32 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fb958db9-f646-4016-b0d2-a985fc395d3a tempest-VolumesExtendTest-1493988835 None] Lock "cinder-quobyte-add8c71f-db82-473a-9357-f487aaf11c01" released by "_delete_snapshot" :: held 2.712s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:32 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fb958db9-f646-4016-b0d2-a985fc395d3a tempest-VolumesExtendTest-1493988835 None] Lock "cinder-quobyte-52c5473e-d235-4395-a6df-5e2f14467e5b" released by "delete_snapshot" :: held 2.775s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:32 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-fb958db9-f646-4016-b0d2-a985fc395d3a tempest-VolumesExtendTest-1493988835 None] Created reservations ['32b651ac-06d9-4e3a-8b7e-c8023612d4a5', '44be90c1-3dee-4b94-8f82-d4df5e5e0980', 'c15206c3-6cc1-48f9-ae63-00b033e7aad1', '28a6e97f-823f-4069-a319-16612fff82f6'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:32 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-fb958db9-f646-4016-b0d2-a985fc395d3a tempest-VolumesExtendTest-1493988835 None] Delete snapshot completed successfully. Sep 28 18:12:32 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fb958db9-f646-4016-b0d2-a985fc395d3a tempest-VolumesExtendTest-1493988835 None] Lock "cinder-add8c71f-db82-473a-9357-f487aaf11c01-delete_snapshot" released by "delete_snapshot" :: held 3.122s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:33 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b4a3ada4-aae9-4786-a7c5-72d548814d34 tempest-VolumesExtendTest-1493988835 None] Acquiring lock "cinder-52c5473e-d235-4395-a6df-5e2f14467e5b-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:33 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Flow 'volume_create_manager' (40f55865-5218-4233-813c-cdf30fac8020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d96175-d393-4e6a-9e79-9dc0630b3937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d96175-d393-4e6a-9e79-9dc0630b3937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2114873890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0b4bfc-b0b6-4f78-be90-6701a96102c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092a5283ad2e41229bc379be35c2d48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:33Z,use_quota=True,user_id='722c1ac0d5164c3bb8c8dd8a5f01e1f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01dcd049-c78f-4531-84a3-c664df499465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01dcd049-c78f-4531-84a3-c664df499465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b614f978-c548-4089-b6f2-df2fea320398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b614f978-c548-4089-b6f2-df2fea320398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af0b4bfc-b0b6-4f78-be90-6701a96102c6', 'volume_name': 'volume-af0b4bfc-b0b6-4f78-be90-6701a96102c6', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d325793-029c-4b7a-b04d-3825ad44eb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d325793-029c-4b7a-b04d-3825ad44eb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5037ea-6f7c-4822-8a17-cc699a0927cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:33 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Volume af0b4bfc-b0b6-4f78-be90-6701a96102c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af0b4bfc-b0b6-4f78-be90-6701a96102c6', 'volume_size': 1} Sep 28 18:12:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2114873890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0b4bfc-b0b6-4f78-be90-6701a96102c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092a5283ad2e41229bc379be35c2d48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:33Z,use_quota=True,user_id='722c1ac0d5164c3bb8c8dd8a5f01e1f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Creating volume af0b4bfc-b0b6-4f78-be90-6701a96102c6 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:33 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:12:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-af0b4bfc-b0b6-4f78-be90-6701a96102c6 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:33 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b4a3ada4-aae9-4786-a7c5-72d548814d34 tempest-VolumesExtendTest-1493988835 None] Lock "cinder-52c5473e-d235-4395-a6df-5e2f14467e5b-delete_volume" acquired by "delete_volume" :: waited 0.200s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:33 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-af0b4bfc-b0b6-4f78-be90-6701a96102c6 1073741824 Sep 28 18:12:33 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:33 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b4a3ada4-aae9-4786-a7c5-72d548814d34 tempest-VolumesExtendTest-1493988835 None] Acquiring lock "cinder-quobyte-52c5473e-d235-4395-a6df-5e2f14467e5b" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:33 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b4a3ada4-aae9-4786-a7c5-72d548814d34 tempest-VolumesExtendTest-1493988835 None] Lock "cinder-quobyte-52c5473e-d235-4395-a6df-5e2f14467e5b" acquired by "delete_volume" :: waited 0.041s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:33 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[79af57ea-ad0b-4872-8dba-df2553b43d70]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b4a3ada4-aae9-4786-a7c5-72d548814d34 tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:33 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b Sep 28 18:12:33 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:34 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b4a3ada4-aae9-4786-a7c5-72d548814d34 tempest-VolumesExtendTest-1493988835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b" returned: 0 in 0.911s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b4a3ada4-aae9-4786-a7c5-72d548814d34 tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:34 devstack sudo[96825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b Sep 28 18:12:34 devstack sudo[96825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:34 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-af0b4bfc-b0b6-4f78-be90-6701a96102c6 1073741824" returned: 0 in 1.270s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-af0b4bfc-b0b6-4f78-be90-6701a96102c6 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:34 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-af0b4bfc-b0b6-4f78-be90-6701a96102c6 Sep 28 18:12:34 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:35 devstack sudo[96825]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b4a3ada4-aae9-4786-a7c5-72d548814d34 tempest-VolumesExtendTest-1493988835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-52c5473e-d235-4395-a6df-5e2f14467e5b" returned: 0 in 0.522s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:35 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b4a3ada4-aae9-4786-a7c5-72d548814d34 tempest-VolumesExtendTest-1493988835 None] Lock "cinder-quobyte-52c5473e-d235-4395-a6df-5e2f14467e5b" released by "delete_volume" :: held 1.591s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:35 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-b4a3ada4-aae9-4786-a7c5-72d548814d34 tempest-VolumesExtendTest-1493988835 None] Created reservations ['ee828f83-466e-4bcb-9a16-f7370928c1a0', '3857719f-548c-4666-a785-f6e87b303d94', '102b4831-ef63-4cab-b212-28e2b145c94d', '500bd38f-cb10-44c1-b422-d021540995d5'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:35 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-af0b4bfc-b0b6-4f78-be90-6701a96102c6" returned: 0 in 0.528s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:35 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] <== create_volume: return (1892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.897s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5037ea-6f7c-4822-8a17-cc699a0927cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af0b4bfc-b0b6-4f78-be90-6701a96102c6', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5fef1ae-d4c7-40f2-bce7-517743d888b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:35 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Volume volume-af0b4bfc-b0b6-4f78-be90-6701a96102c6 (af0b4bfc-b0b6-4f78-be90-6701a96102c6): created successfully Sep 28 18:12:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5fef1ae-d4c7-40f2-bce7-517743d888b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Flow 'volume_create_manager' (40f55865-5218-4233-813c-cdf30fac8020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b4a3ada4-aae9-4786-a7c5-72d548814d34 tempest-VolumesExtendTest-1493988835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b4a3ada4-aae9-4786-a7c5-72d548814d34 tempest-VolumesExtendTest-1493988835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:35 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b4a3ada4-aae9-4786-a7c5-72d548814d34 tempest-VolumesExtendTest-1493988835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:35 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b4a3ada4-aae9-4786-a7c5-72d548814d34 tempest-VolumesExtendTest-1493988835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b4a3ada4-aae9-4786-a7c5-72d548814d34 tempest-VolumesExtendTest-1493988835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b4a3ada4-aae9-4786-a7c5-72d548814d34 tempest-VolumesExtendTest-1493988835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:35 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-32a53205-a6ad-4404-906b-0a3db5d52c73 tempest-VolumesListAdminTestJSON-2095154180 None] Created volume successfully. Sep 28 18:12:35 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:12:35 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:35 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b4a3ada4-aae9-4786-a7c5-72d548814d34 tempest-VolumesExtendTest-1493988835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.393s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:35 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-b4a3ada4-aae9-4786-a7c5-72d548814d34 tempest-VolumesExtendTest-1493988835 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:35 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-b4a3ada4-aae9-4786-a7c5-72d548814d34 tempest-VolumesExtendTest-1493988835 None] Deleted volume successfully. Sep 28 18:12:35 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b4a3ada4-aae9-4786-a7c5-72d548814d34 tempest-VolumesExtendTest-1493988835 None] Lock "cinder-52c5473e-d235-4395-a6df-5e2f14467e5b-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:37 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Flow 'volume_create_manager' (deb7b00a-c0d1-4489-ab74-0d76a403325c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cad6983-3996-4caa-82ea-4d6b6a410eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cad6983-3996-4caa-82ea-4d6b6a410eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-997890022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f888c4-6639-4fe4-a8c8-948c6365899a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092a5283ad2e41229bc379be35c2d48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:38Z,use_quota=True,user_id='722c1ac0d5164c3bb8c8dd8a5f01e1f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a571c3-d290-4453-ac11-4edfaa32855d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a571c3-d290-4453-ac11-4edfaa32855d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5844cad8-2514-41f2-91bf-a3c542916600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5844cad8-2514-41f2-91bf-a3c542916600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9f888c4-6639-4fe4-a8c8-948c6365899a', 'volume_name': 'volume-e9f888c4-6639-4fe4-a8c8-948c6365899a', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ea8ec9-7f6d-4860-bd8e-3182bd872db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ea8ec9-7f6d-4860-bd8e-3182bd872db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f6401ab-89a1-4ca7-b927-6ecd6b60ee5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:37 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Volume e9f888c4-6639-4fe4-a8c8-948c6365899a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9f888c4-6639-4fe4-a8c8-948c6365899a', 'volume_size': 1} Sep 28 18:12:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-997890022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f888c4-6639-4fe4-a8c8-948c6365899a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092a5283ad2e41229bc379be35c2d48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:38Z,use_quota=True,user_id='722c1ac0d5164c3bb8c8dd8a5f01e1f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Creating volume e9f888c4-6639-4fe4-a8c8-948c6365899a {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:37 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:12:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e9f888c4-6639-4fe4-a8c8-948c6365899a 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:37 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e9f888c4-6639-4fe4-a8c8-948c6365899a 1073741824 Sep 28 18:12:37 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:38 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e9f888c4-6639-4fe4-a8c8-948c6365899a 1073741824" returned: 0 in 0.928s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e9f888c4-6639-4fe4-a8c8-948c6365899a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:38 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e9f888c4-6639-4fe4-a8c8-948c6365899a Sep 28 18:12:38 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:39 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e9f888c4-6639-4fe4-a8c8-948c6365899a" returned: 0 in 0.424s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f6401ab-89a1-4ca7-b927-6ecd6b60ee5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9f888c4-6639-4fe4-a8c8-948c6365899a', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad58519-29a1-4233-b7ff-2b253c7e3260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:39 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Volume volume-e9f888c4-6639-4fe4-a8c8-948c6365899a (e9f888c4-6639-4fe4-a8c8-948c6365899a): created successfully Sep 28 18:12:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad58519-29a1-4233-b7ff-2b253c7e3260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Flow 'volume_create_manager' (deb7b00a-c0d1-4489-ab74-0d76a403325c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:39 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-f5f7c5de-7c4e-451a-a95a-3a296bf47d06 tempest-VolumesListAdminTestJSON-2095154180 None] Created volume successfully. Sep 28 18:12:40 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:40 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Flow 'volume_create_manager' (3cf895e4-c05d-49a2-bb10-1102b7c853d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:40 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc8a510-ab02-402f-97b6-54e06e576eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:40 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc8a510-ab02-402f-97b6-54e06e576eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-935717106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=700d79b7-4884-47fe-8c36-0b1247a03d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092a5283ad2e41229bc379be35c2d48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:41Z,use_quota=True,user_id='722c1ac0d5164c3bb8c8dd8a5f01e1f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:40 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf35216d-a439-4fe6-a3b7-dae2302a5bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:40 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf35216d-a439-4fe6-a3b7-dae2302a5bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:40 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b495fbf3-dfa9-4021-9c85-c847ccf7bd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:40 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b495fbf3-dfa9-4021-9c85-c847ccf7bd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '700d79b7-4884-47fe-8c36-0b1247a03d0b', 'volume_name': 'volume-700d79b7-4884-47fe-8c36-0b1247a03d0b', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:40 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f1fb810-15ea-48b9-94e0-7d2564fdd6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:40 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f1fb810-15ea-48b9-94e0-7d2564fdd6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:40 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2f1567-a065-4336-8533-b1694f68d79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:40 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Volume 700d79b7-4884-47fe-8c36-0b1247a03d0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-700d79b7-4884-47fe-8c36-0b1247a03d0b', 'volume_size': 1} Sep 28 18:12:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:41 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-935717106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=700d79b7-4884-47fe-8c36-0b1247a03d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092a5283ad2e41229bc379be35c2d48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:41Z,use_quota=True,user_id='722c1ac0d5164c3bb8c8dd8a5f01e1f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:41 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Creating volume 700d79b7-4884-47fe-8c36-0b1247a03d0b {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:41 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:41 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:41 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:41 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:12:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-700d79b7-4884-47fe-8c36-0b1247a03d0b 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:41 devstack sudo[96884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-700d79b7-4884-47fe-8c36-0b1247a03d0b 1073741824 Sep 28 18:12:41 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:41 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-700d79b7-4884-47fe-8c36-0b1247a03d0b 1073741824" returned: 0 in 0.951s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-700d79b7-4884-47fe-8c36-0b1247a03d0b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:42 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-700d79b7-4884-47fe-8c36-0b1247a03d0b Sep 28 18:12:42 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:42 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-700d79b7-4884-47fe-8c36-0b1247a03d0b" returned: 0 in 0.420s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:42 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2f1567-a065-4336-8533-b1694f68d79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-700d79b7-4884-47fe-8c36-0b1247a03d0b', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:42 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df373e2-73f6-47f4-8375-dd4ce3976546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:42 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Volume volume-700d79b7-4884-47fe-8c36-0b1247a03d0b (700d79b7-4884-47fe-8c36-0b1247a03d0b): created successfully Sep 28 18:12:42 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df373e2-73f6-47f4-8375-dd4ce3976546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:42 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Flow 'volume_create_manager' (3cf895e4-c05d-49a2-bb10-1102b7c853d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:42 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-bf37bd65-ff78-4783-927b-78808a2f3f02 tempest-VolumesListAdminTestJSON-2095154180 None] Created volume successfully. Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Flow 'volume_create_manager' (cacd55ab-0950-453d-b815-46a20b997771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a5a779-0010-4ece-b920-9ff6335915f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a5a779-0010-4ece-b920-9ff6335915f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-91166728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a582fdd2-2aae-47c1-a031-071670a66161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='720456a053fe49729b81f1861ec91fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:43Z,use_quota=True,user_id='182f5d2495e64abf962432e9e0157fbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4353be-f01a-4d56-95f4-02eb0d9a5f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4353be-f01a-4d56-95f4-02eb0d9a5f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f763da-0621-4e9d-a3a9-2f7b3552a88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f763da-0621-4e9d-a3a9-2f7b3552a88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a582fdd2-2aae-47c1-a031-071670a66161', 'volume_name': 'volume-a582fdd2-2aae-47c1-a031-071670a66161', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8a69158-631f-4bea-ae23-e5e770049e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8a69158-631f-4bea-ae23-e5e770049e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf113c64-77f7-449b-a7a7-6b8a43b11a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:43 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Volume a582fdd2-2aae-47c1-a031-071670a66161: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a582fdd2-2aae-47c1-a031-071670a66161', 'volume_size': 1} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-91166728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a582fdd2-2aae-47c1-a031-071670a66161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='720456a053fe49729b81f1861ec91fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:43Z,use_quota=True,user_id='182f5d2495e64abf962432e9e0157fbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Creating volume a582fdd2-2aae-47c1-a031-071670a66161 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:43 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:43 devstack sudo[96897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161 1073741824 Sep 28 18:12:43 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Flow 'volume_create_manager' (e7844ae8-dd98-46dc-b555-7812b7c31c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a787199c-d5a8-47be-a4dd-87e0a2f52455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a787199c-d5a8-47be-a4dd-87e0a2f52455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1920203684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88d905c1-37fd-480d-b700-f883aa7bf536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2554b8605c947aa8f45f0a5a6810a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:43Z,use_quota=True,user_id='cd253966d7c849b1b17a9b96a5cc1a15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4d206a7-0a39-4eff-bacc-4521e79faffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4d206a7-0a39-4eff-bacc-4521e79faffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e8bf2e-6ca2-452b-82a3-c060f173ee99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e8bf2e-6ca2-452b-82a3-c060f173ee99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88d905c1-37fd-480d-b700-f883aa7bf536', 'volume_name': 'volume-88d905c1-37fd-480d-b700-f883aa7bf536', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06eafcb-2d80-4bd0-9652-2d2fbe41599c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06eafcb-2d80-4bd0-9652-2d2fbe41599c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d7700bc-a3f4-4872-9c36-e2891f69904c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:43 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Volume 88d905c1-37fd-480d-b700-f883aa7bf536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88d905c1-37fd-480d-b700-f883aa7bf536', 'volume_size': 1} Sep 28 18:12:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:44 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161 1073741824" returned: 0 in 0.622s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:44 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161 Sep 28 18:12:44 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Flow 'volume_create_manager' (298e15ce-748a-4881-8e74-616cc525cb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052ceb1d-dcbc-46d9-a64e-d4f8ba2991d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052ceb1d-dcbc-46d9-a64e-d4f8ba2991d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c1e9fad-c62a-40e6-8385-ecbfea8d7275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='674134e879c442329b1a5c53f93c320a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:44Z,use_quota=True,user_id='e56d3fa2e24a4877beeca5144fbef160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1121ac1-b338-490a-ac7c-1d158134c680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1121ac1-b338-490a-ac7c-1d158134c680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0e602b2-2398-4ad2-a17b-8b167ca2aeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0e602b2-2398-4ad2-a17b-8b167ca2aeb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c1e9fad-c62a-40e6-8385-ecbfea8d7275', 'volume_name': 'volume-1c1e9fad-c62a-40e6-8385-ecbfea8d7275', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a23c6c53-f04d-4a86-b5ba-6b6fde97ffe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a23c6c53-f04d-4a86-b5ba-6b6fde97ffe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad54d8f9-ff2d-4fd5-a5bd-a575bd8bef7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:44 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Volume 1c1e9fad-c62a-40e6-8385-ecbfea8d7275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c1e9fad-c62a-40e6-8385-ecbfea8d7275', 'volume_size': 1} Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:44 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161" returned: 0 in 0.326s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.861s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1920203684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88d905c1-37fd-480d-b700-f883aa7bf536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2554b8605c947aa8f45f0a5a6810a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:43Z,use_quota=True,user_id='cd253966d7c849b1b17a9b96a5cc1a15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Creating volume 88d905c1-37fd-480d-b700-f883aa7bf536 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:44 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88d905c1-37fd-480d-b700-f883aa7bf536 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf113c64-77f7-449b-a7a7-6b8a43b11a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a582fdd2-2aae-47c1-a031-071670a66161', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:44 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88d905c1-37fd-480d-b700-f883aa7bf536 1073741824 Sep 28 18:12:44 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14c4ed0-af5a-4f48-a655-f2e85c5e44c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:44 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Volume volume-a582fdd2-2aae-47c1-a031-071670a66161 (a582fdd2-2aae-47c1-a031-071670a66161): created successfully Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14c4ed0-af5a-4f48-a655-f2e85c5e44c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Flow 'volume_create_manager' (cacd55ab-0950-453d-b815-46a20b997771) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:44 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-90303d51-589c-44fd-b17b-250dc4e37871 tempest-VolumesDeleteCascade-1502592551 None] Created volume successfully. Sep 28 18:12:44 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88d905c1-37fd-480d-b700-f883aa7bf536 1073741824" returned: 0 in 0.483s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88d905c1-37fd-480d-b700-f883aa7bf536 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:45 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88d905c1-37fd-480d-b700-f883aa7bf536 Sep 28 18:12:45 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:45 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88d905c1-37fd-480d-b700-f883aa7bf536" returned: 0 in 0.374s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:45 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.016s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:45 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c1e9fad-c62a-40e6-8385-ecbfea8d7275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='674134e879c442329b1a5c53f93c320a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:12:44Z,use_quota=True,user_id='e56d3fa2e24a4877beeca5144fbef160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:12:45 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Creating volume 1c1e9fad-c62a-40e6-8385-ecbfea8d7275 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:12:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:45 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:45 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:45 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:12:45 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:12:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c1e9fad-c62a-40e6-8385-ecbfea8d7275 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:45 devstack sudo[96914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c1e9fad-c62a-40e6-8385-ecbfea8d7275 1073741824 Sep 28 18:12:45 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:45 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d7700bc-a3f4-4872-9c36-e2891f69904c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88d905c1-37fd-480d-b700-f883aa7bf536', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:45 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7778b591-c4bc-4c84-91ba-ea68a02d2334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e4fd881d-e08e-4e0b-9537-bce87b887eed tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:45 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Volume volume-88d905c1-37fd-480d-b700-f883aa7bf536 (88d905c1-37fd-480d-b700-f883aa7bf536): created successfully Sep 28 18:12:45 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7778b591-c4bc-4c84-91ba-ea68a02d2334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:45 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Flow 'volume_create_manager' (e7844ae8-dd98-46dc-b555-7812b7c31c16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:45 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:UPDATE=141,cinder:DELETE=10,cinder:SELECT=103,cinder:INSERT=37 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:12:45 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-de561fbf-b510-42d0-a13e-4629e37b79fa tempest-VolumesNegativeTest-1732955512 None] Created volume successfully. Sep 28 18:12:45 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:UPDATE=122,cinder:SELECT=107,cinder:INSERT=47,cinder:DELETE=13 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:12:45 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c1e9fad-c62a-40e6-8385-ecbfea8d7275 1073741824" returned: 0 in 0.478s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c1e9fad-c62a-40e6-8385-ecbfea8d7275 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:45 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c1e9fad-c62a-40e6-8385-ecbfea8d7275 Sep 28 18:12:45 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:46 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c1e9fad-c62a-40e6-8385-ecbfea8d7275" returned: 0 in 0.278s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:46 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:12:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e4fd881d-e08e-4e0b-9537-bce87b887eed tempest-VolumesDeleteCascade-1502592551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.731s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:46 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad54d8f9-ff2d-4fd5-a5bd-a575bd8bef7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c1e9fad-c62a-40e6-8385-ecbfea8d7275', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:46 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ffbe19-b9b2-4654-a8a0-a1b28e30478d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:12:46 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-e4fd881d-e08e-4e0b-9537-bce87b887eed tempest-VolumesDeleteCascade-1502592551 None] Creating offline snapshot 3b0edee6-c642-429d-b4ae-63e123c3f067 of volume a582fdd2-2aae-47c1-a031-071670a66161 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:12:46 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Volume volume-1c1e9fad-c62a-40e6-8385-ecbfea8d7275 (1c1e9fad-c62a-40e6-8385-ecbfea8d7275): created successfully Sep 28 18:12:46 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ffbe19-b9b2-4654-a8a0-a1b28e30478d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:12:46 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Flow 'volume_create_manager' (298e15ce-748a-4881-8e74-616cc525cb63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:12:46 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d376223-5aba-45a7-a5a0-3be9ccb2026f]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e4fd881d-e08e-4e0b-9537-bce87b887eed tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:46 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-2deb4d9d-38b8-42ce-a248-b3fb410d3e4e tempest-VolumesListAdminTestJSON-1154386377 None] Created volume successfully. Sep 28 18:12:46 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161 Sep 28 18:12:46 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:46 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e4fd881d-e08e-4e0b-9537-bce87b887eed tempest-VolumesDeleteCascade-1502592551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161" returned: 0 in 0.472s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e4fd881d-e08e-4e0b-9537-bce87b887eed tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:46 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067 1G Sep 28 18:12:46 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:47 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e4fd881d-e08e-4e0b-9537-bce87b887eed tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067 1G" returned: 0 in 0.546s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e4fd881d-e08e-4e0b-9537-bce87b887eed tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a582fdd2-2aae-47c1-a031-071670a66161 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:47 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a582fdd2-2aae-47c1-a031-071670a66161 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067 Sep 28 18:12:47 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a1ab96ae-dbb1-40a4-9204-a4174fc2b273 tempest-VolumesListAdminTestJSON-1154386377 None] Acquiring lock "cinder-1c1e9fad-c62a-40e6-8385-ecbfea8d7275-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a1ab96ae-dbb1-40a4-9204-a4174fc2b273 tempest-VolumesListAdminTestJSON-1154386377 None] Lock "cinder-1c1e9fad-c62a-40e6-8385-ecbfea8d7275-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a1ab96ae-dbb1-40a4-9204-a4174fc2b273 tempest-VolumesListAdminTestJSON-1154386377 None] Acquiring lock "cinder-quobyte-1c1e9fad-c62a-40e6-8385-ecbfea8d7275" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a1ab96ae-dbb1-40a4-9204-a4174fc2b273 tempest-VolumesListAdminTestJSON-1154386377 None] Lock "cinder-quobyte-1c1e9fad-c62a-40e6-8385-ecbfea8d7275" acquired by "delete_volume" :: waited 0.035s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:47 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28d6d95-7df4-4718-898f-608a19e803a8]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a1ab96ae-dbb1-40a4-9204-a4174fc2b273 tempest-VolumesListAdminTestJSON-1154386377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c1e9fad-c62a-40e6-8385-ecbfea8d7275 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ad36f664-5d4a-4e3f-9f29-affa6cb81d5d tempest-VolumesListAdminTestJSON-2095154180 None] Acquiring lock "cinder-700d79b7-4884-47fe-8c36-0b1247a03d0b-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:48 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ad36f664-5d4a-4e3f-9f29-affa6cb81d5d tempest-VolumesListAdminTestJSON-2095154180 None] Lock "cinder-700d79b7-4884-47fe-8c36-0b1247a03d0b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:48 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:48 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ad36f664-5d4a-4e3f-9f29-affa6cb81d5d tempest-VolumesListAdminTestJSON-2095154180 None] Acquiring lock "cinder-quobyte-700d79b7-4884-47fe-8c36-0b1247a03d0b" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e4fd881d-e08e-4e0b-9537-bce87b887eed tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a582fdd2-2aae-47c1-a031-071670a66161 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067" returned: 0 in 0.832s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:48 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-e4fd881d-e08e-4e0b-9537-bce87b887eed tempest-VolumesDeleteCascade-1502592551 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067 is being set with open permissions: ugo+rw Sep 28 18:12:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e4fd881d-e08e-4e0b-9537-bce87b887eed tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:48 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067 Sep 28 18:12:48 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:48 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ad36f664-5d4a-4e3f-9f29-affa6cb81d5d tempest-VolumesListAdminTestJSON-2095154180 None] Lock "cinder-quobyte-700d79b7-4884-47fe-8c36-0b1247a03d0b" acquired by "delete_volume" :: waited 0.079s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:48 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c1e9fad-c62a-40e6-8385-ecbfea8d7275 Sep 28 18:12:48 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:48 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9a13dc-1664-44b8-bac9-f30fe6403aac]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ad36f664-5d4a-4e3f-9f29-affa6cb81d5d tempest-VolumesListAdminTestJSON-2095154180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-700d79b7-4884-47fe-8c36-0b1247a03d0b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:48 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-700d79b7-4884-47fe-8c36-0b1247a03d0b Sep 28 18:12:48 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:48 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a1ab96ae-dbb1-40a4-9204-a4174fc2b273 tempest-VolumesListAdminTestJSON-1154386377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c1e9fad-c62a-40e6-8385-ecbfea8d7275" returned: 0 in 0.851s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a1ab96ae-dbb1-40a4-9204-a4174fc2b273 tempest-VolumesListAdminTestJSON-1154386377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c1e9fad-c62a-40e6-8385-ecbfea8d7275 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:48 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:48 devstack sudo[96953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c1e9fad-c62a-40e6-8385-ecbfea8d7275 Sep 28 18:12:48 devstack sudo[96953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e4fd881d-e08e-4e0b-9537-bce87b887eed tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067" returned: 0 in 0.657s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e4fd881d-e08e-4e0b-9537-bce87b887eed tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:48 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.info Sep 28 18:12:48 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:49 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ad36f664-5d4a-4e3f-9f29-affa6cb81d5d tempest-VolumesListAdminTestJSON-2095154180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-700d79b7-4884-47fe-8c36-0b1247a03d0b" returned: 0 in 1.066s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ad36f664-5d4a-4e3f-9f29-affa6cb81d5d tempest-VolumesListAdminTestJSON-2095154180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-700d79b7-4884-47fe-8c36-0b1247a03d0b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:49 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:49 devstack sudo[96953]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e4fd881d-e08e-4e0b-9537-bce87b887eed tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.info" returned: 0 in 0.526s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:49 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-e4fd881d-e08e-4e0b-9537-bce87b887eed tempest-VolumesDeleteCascade-1502592551 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.info is being set with open permissions: ugo+rw Sep 28 18:12:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e4fd881d-e08e-4e0b-9537-bce87b887eed tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a1ab96ae-dbb1-40a4-9204-a4174fc2b273 tempest-VolumesListAdminTestJSON-1154386377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c1e9fad-c62a-40e6-8385-ecbfea8d7275" returned: 0 in 0.613s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:49 devstack sudo[96962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-700d79b7-4884-47fe-8c36-0b1247a03d0b Sep 28 18:12:49 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:49 devstack sudo[96963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.info Sep 28 18:12:49 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a1ab96ae-dbb1-40a4-9204-a4174fc2b273 tempest-VolumesListAdminTestJSON-1154386377 None] Lock "cinder-quobyte-1c1e9fad-c62a-40e6-8385-ecbfea8d7275" released by "delete_volume" :: held 1.571s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:49 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:49 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-a1ab96ae-dbb1-40a4-9204-a4174fc2b273 tempest-VolumesListAdminTestJSON-1154386377 None] Created reservations ['347ccc31-61bc-45ab-b9c0-92d2a4cf606c', 'f5e9f3f8-b196-495d-afa4-93e20e445ada', '3a524efc-5ec4-4a08-9998-12a505385d26', 'b08af57a-7642-4dd8-b21b-c4d7cc434169'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a1ab96ae-dbb1-40a4-9204-a4174fc2b273 tempest-VolumesListAdminTestJSON-1154386377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a1ab96ae-dbb1-40a4-9204-a4174fc2b273 tempest-VolumesListAdminTestJSON-1154386377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a1ab96ae-dbb1-40a4-9204-a4174fc2b273 tempest-VolumesListAdminTestJSON-1154386377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a1ab96ae-dbb1-40a4-9204-a4174fc2b273 tempest-VolumesListAdminTestJSON-1154386377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a1ab96ae-dbb1-40a4-9204-a4174fc2b273 tempest-VolumesListAdminTestJSON-1154386377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a1ab96ae-dbb1-40a4-9204-a4174fc2b273 tempest-VolumesListAdminTestJSON-1154386377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:49 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:12:49 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:49 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e4fd881d-e08e-4e0b-9537-bce87b887eed tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.info" returned: 0 in 0.552s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:49 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e4fd881d-e08e-4e0b-9537-bce87b887eed tempest-VolumesDeleteCascade-1502592551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.740s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ad36f664-5d4a-4e3f-9f29-affa6cb81d5d tempest-VolumesListAdminTestJSON-2095154180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-700d79b7-4884-47fe-8c36-0b1247a03d0b" returned: 0 in 0.597s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:49 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ad36f664-5d4a-4e3f-9f29-affa6cb81d5d tempest-VolumesListAdminTestJSON-2095154180 None] Lock "cinder-quobyte-700d79b7-4884-47fe-8c36-0b1247a03d0b" released by "delete_volume" :: held 1.768s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:50 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-e4fd881d-e08e-4e0b-9537-bce87b887eed tempest-VolumesDeleteCascade-1502592551 None] Create snapshot completed successfully Sep 28 18:12:50 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-ad36f664-5d4a-4e3f-9f29-affa6cb81d5d tempest-VolumesListAdminTestJSON-2095154180 None] Created reservations ['c78c0bfc-9198-481c-a2d1-9146d1231f57', '1cc3bd9d-28cb-4465-8ff9-c0f137dc1fe4', 'cc512940-6b63-4948-89f1-888d3dd83bbb', '0e02e98b-dfd2-4a59-a49f-d1843acc79dc'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ad36f664-5d4a-4e3f-9f29-affa6cb81d5d tempest-VolumesListAdminTestJSON-2095154180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ad36f664-5d4a-4e3f-9f29-affa6cb81d5d tempest-VolumesListAdminTestJSON-2095154180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ad36f664-5d4a-4e3f-9f29-affa6cb81d5d tempest-VolumesListAdminTestJSON-2095154180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ad36f664-5d4a-4e3f-9f29-affa6cb81d5d tempest-VolumesListAdminTestJSON-2095154180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ad36f664-5d4a-4e3f-9f29-affa6cb81d5d tempest-VolumesListAdminTestJSON-2095154180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ad36f664-5d4a-4e3f-9f29-affa6cb81d5d tempest-VolumesListAdminTestJSON-2095154180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:50 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:50 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:12:50 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a1ab96ae-dbb1-40a4-9204-a4174fc2b273 tempest-VolumesListAdminTestJSON-1154386377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.472s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:50 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-a1ab96ae-dbb1-40a4-9204-a4174fc2b273 tempest-VolumesListAdminTestJSON-1154386377 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:50 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-a1ab96ae-dbb1-40a4-9204-a4174fc2b273 tempest-VolumesListAdminTestJSON-1154386377 None] Deleted volume successfully. Sep 28 18:12:50 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a1ab96ae-dbb1-40a4-9204-a4174fc2b273 tempest-VolumesListAdminTestJSON-1154386377 None] Lock "cinder-1c1e9fad-c62a-40e6-8385-ecbfea8d7275-delete_volume" released by "delete_volume" :: held 2.689s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:50 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f8169714-cc87-4dfb-82b0-231989c47897 tempest-VolumesListAdminTestJSON-2095154180 None] Acquiring lock "cinder-e9f888c4-6639-4fe4-a8c8-948c6365899a-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:50 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f8169714-cc87-4dfb-82b0-231989c47897 tempest-VolumesListAdminTestJSON-2095154180 None] Lock "cinder-e9f888c4-6639-4fe4-a8c8-948c6365899a-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:50 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ad36f664-5d4a-4e3f-9f29-affa6cb81d5d tempest-VolumesListAdminTestJSON-2095154180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.666s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:50 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-ad36f664-5d4a-4e3f-9f29-affa6cb81d5d tempest-VolumesListAdminTestJSON-2095154180 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:50 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-ad36f664-5d4a-4e3f-9f29-affa6cb81d5d tempest-VolumesListAdminTestJSON-2095154180 None] Deleted volume successfully. Sep 28 18:12:51 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f8169714-cc87-4dfb-82b0-231989c47897 tempest-VolumesListAdminTestJSON-2095154180 None] Acquiring lock "cinder-quobyte-e9f888c4-6639-4fe4-a8c8-948c6365899a" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:51 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ad36f664-5d4a-4e3f-9f29-affa6cb81d5d tempest-VolumesListAdminTestJSON-2095154180 None] Lock "cinder-700d79b7-4884-47fe-8c36-0b1247a03d0b-delete_volume" released by "delete_volume" :: held 3.038s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:51 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f8169714-cc87-4dfb-82b0-231989c47897 tempest-VolumesListAdminTestJSON-2095154180 None] Lock "cinder-quobyte-e9f888c4-6639-4fe4-a8c8-948c6365899a" acquired by "delete_volume" :: waited 0.067s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:51 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7371c55-df7a-439c-9707-a496c231db28]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f8169714-cc87-4dfb-82b0-231989c47897 tempest-VolumesListAdminTestJSON-2095154180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e9f888c4-6639-4fe4-a8c8-948c6365899a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:51 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e9f888c4-6639-4fe4-a8c8-948c6365899a Sep 28 18:12:51 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-643cc57f-8d69-4ea2-9051-e2a9d6964f7c tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-643cc57f-8d69-4ea2-9051-e2a9d6964f7c tempest-VolumesDeleteCascade-1502592551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:51 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-643cc57f-8d69-4ea2-9051-e2a9d6964f7c tempest-VolumesDeleteCascade-1502592551 None] Creating offline snapshot 46b39fe8-dba8-4e9a-b0de-4a138b3c0981 of volume a582fdd2-2aae-47c1-a031-071670a66161 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:12:51 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[111a8b5b-0705-44f7-8c48-83a94527f704]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-643cc57f-8d69-4ea2-9051-e2a9d6964f7c tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:51 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f8169714-cc87-4dfb-82b0-231989c47897 tempest-VolumesListAdminTestJSON-2095154180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e9f888c4-6639-4fe4-a8c8-948c6365899a" returned: 0 in 0.809s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f8169714-cc87-4dfb-82b0-231989c47897 tempest-VolumesListAdminTestJSON-2095154180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e9f888c4-6639-4fe4-a8c8-948c6365899a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:52 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e9f888c4-6639-4fe4-a8c8-948c6365899a Sep 28 18:12:52 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067 Sep 28 18:12:52 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:52 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:52 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f8169714-cc87-4dfb-82b0-231989c47897 tempest-VolumesListAdminTestJSON-2095154180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e9f888c4-6639-4fe4-a8c8-948c6365899a" returned: 0 in 0.372s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:52 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f8169714-cc87-4dfb-82b0-231989c47897 tempest-VolumesListAdminTestJSON-2095154180 None] Lock "cinder-quobyte-e9f888c4-6639-4fe4-a8c8-948c6365899a" released by "delete_volume" :: held 1.288s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:52 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-643cc57f-8d69-4ea2-9051-e2a9d6964f7c tempest-VolumesDeleteCascade-1502592551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067" returned: 0 in 0.559s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:52 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-643cc57f-8d69-4ea2-9051-e2a9d6964f7c tempest-VolumesDeleteCascade-1502592551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a582fdd2-2aae-47c1-a031-071670a66161(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:12:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-643cc57f-8d69-4ea2-9051-e2a9d6964f7c tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.46b39fe8-dba8-4e9a-b0de-4a138b3c0981 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:52 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.46b39fe8-dba8-4e9a-b0de-4a138b3c0981 1G Sep 28 18:12:52 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:52 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-f8169714-cc87-4dfb-82b0-231989c47897 tempest-VolumesListAdminTestJSON-2095154180 None] Created reservations ['976e102e-1dc7-48ab-955c-51d884ab4906', 'f98c92ec-1d8d-41da-83da-3c381b308288', '1f9da53f-0a24-430f-9097-44bec3627524', 'b6f9e94c-e9a4-4126-a118-3028f4c4ddcd'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f8169714-cc87-4dfb-82b0-231989c47897 tempest-VolumesListAdminTestJSON-2095154180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f8169714-cc87-4dfb-82b0-231989c47897 tempest-VolumesListAdminTestJSON-2095154180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:52 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f8169714-cc87-4dfb-82b0-231989c47897 tempest-VolumesListAdminTestJSON-2095154180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:52 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f8169714-cc87-4dfb-82b0-231989c47897 tempest-VolumesListAdminTestJSON-2095154180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f8169714-cc87-4dfb-82b0-231989c47897 tempest-VolumesListAdminTestJSON-2095154180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f8169714-cc87-4dfb-82b0-231989c47897 tempest-VolumesListAdminTestJSON-2095154180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:52 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:12:52 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:52 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f8169714-cc87-4dfb-82b0-231989c47897 tempest-VolumesListAdminTestJSON-2095154180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.343s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:52 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-f8169714-cc87-4dfb-82b0-231989c47897 tempest-VolumesListAdminTestJSON-2095154180 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:52 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-f8169714-cc87-4dfb-82b0-231989c47897 tempest-VolumesListAdminTestJSON-2095154180 None] Deleted volume successfully. Sep 28 18:12:52 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f8169714-cc87-4dfb-82b0-231989c47897 tempest-VolumesListAdminTestJSON-2095154180 None] Lock "cinder-e9f888c4-6639-4fe4-a8c8-948c6365899a-delete_volume" released by "delete_volume" :: held 2.137s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:53 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-643cc57f-8d69-4ea2-9051-e2a9d6964f7c tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.46b39fe8-dba8-4e9a-b0de-4a138b3c0981 1G" returned: 0 in 0.717s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-643cc57f-8d69-4ea2-9051-e2a9d6964f7c tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.46b39fe8-dba8-4e9a-b0de-4a138b3c0981 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:53 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.46b39fe8-dba8-4e9a-b0de-4a138b3c0981 Sep 28 18:12:53 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:53 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e0eed074-2742-4fbf-8801-0c3e3738af30 tempest-VolumesListAdminTestJSON-2095154180 None] Acquiring lock "cinder-af0b4bfc-b0b6-4f78-be90-6701a96102c6-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:53 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e0eed074-2742-4fbf-8801-0c3e3738af30 tempest-VolumesListAdminTestJSON-2095154180 None] Lock "cinder-af0b4bfc-b0b6-4f78-be90-6701a96102c6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:53 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e0eed074-2742-4fbf-8801-0c3e3738af30 tempest-VolumesListAdminTestJSON-2095154180 None] Acquiring lock "cinder-quobyte-af0b4bfc-b0b6-4f78-be90-6701a96102c6" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:53 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e0eed074-2742-4fbf-8801-0c3e3738af30 tempest-VolumesListAdminTestJSON-2095154180 None] Lock "cinder-quobyte-af0b4bfc-b0b6-4f78-be90-6701a96102c6" acquired by "delete_volume" :: waited 0.021s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:53 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b369c0-41d6-481f-84f6-6218c2aa82d0]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e0eed074-2742-4fbf-8801-0c3e3738af30 tempest-VolumesListAdminTestJSON-2095154180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-af0b4bfc-b0b6-4f78-be90-6701a96102c6 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:53 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-643cc57f-8d69-4ea2-9051-e2a9d6964f7c tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.46b39fe8-dba8-4e9a-b0de-4a138b3c0981" returned: 0 in 0.462s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:53 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-643cc57f-8d69-4ea2-9051-e2a9d6964f7c tempest-VolumesDeleteCascade-1502592551 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.46b39fe8-dba8-4e9a-b0de-4a138b3c0981 is being set with open permissions: ugo+rw Sep 28 18:12:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-643cc57f-8d69-4ea2-9051-e2a9d6964f7c tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.46b39fe8-dba8-4e9a-b0de-4a138b3c0981 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:53 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.46b39fe8-dba8-4e9a-b0de-4a138b3c0981 Sep 28 18:12:53 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:53 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-af0b4bfc-b0b6-4f78-be90-6701a96102c6 Sep 28 18:12:53 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:53 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-643cc57f-8d69-4ea2-9051-e2a9d6964f7c tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.46b39fe8-dba8-4e9a-b0de-4a138b3c0981" returned: 0 in 0.335s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-643cc57f-8d69-4ea2-9051-e2a9d6964f7c tempest-VolumesDeleteCascade-1502592551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.263s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:53 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:54 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-643cc57f-8d69-4ea2-9051-e2a9d6964f7c tempest-VolumesDeleteCascade-1502592551 None] Create snapshot completed successfully Sep 28 18:12:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e0eed074-2742-4fbf-8801-0c3e3738af30 tempest-VolumesListAdminTestJSON-2095154180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-af0b4bfc-b0b6-4f78-be90-6701a96102c6" returned: 0 in 0.535s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e0eed074-2742-4fbf-8801-0c3e3738af30 tempest-VolumesListAdminTestJSON-2095154180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-af0b4bfc-b0b6-4f78-be90-6701a96102c6 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:54 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-af0b4bfc-b0b6-4f78-be90-6701a96102c6 Sep 28 18:12:54 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:54 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e0eed074-2742-4fbf-8801-0c3e3738af30 tempest-VolumesListAdminTestJSON-2095154180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-af0b4bfc-b0b6-4f78-be90-6701a96102c6" returned: 0 in 0.317s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:54 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e0eed074-2742-4fbf-8801-0c3e3738af30 tempest-VolumesListAdminTestJSON-2095154180 None] Lock "cinder-quobyte-af0b4bfc-b0b6-4f78-be90-6701a96102c6" released by "delete_volume" :: held 0.915s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:54 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-e0eed074-2742-4fbf-8801-0c3e3738af30 tempest-VolumesListAdminTestJSON-2095154180 None] Created reservations ['f8adade9-0579-4561-b438-c69ea5670a69', '74c3f8f1-15bd-4f4e-8928-1f50488d82f1', '12988346-2d90-4927-8e50-38a1ffb2d394', 'eeaecbfe-43b7-49f1-b71f-9b89e62ac3b1'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:12:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e0eed074-2742-4fbf-8801-0c3e3738af30 tempest-VolumesListAdminTestJSON-2095154180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:12:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e0eed074-2742-4fbf-8801-0c3e3738af30 tempest-VolumesListAdminTestJSON-2095154180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:12:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e0eed074-2742-4fbf-8801-0c3e3738af30 tempest-VolumesListAdminTestJSON-2095154180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:12:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e0eed074-2742-4fbf-8801-0c3e3738af30 tempest-VolumesListAdminTestJSON-2095154180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:12:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e0eed074-2742-4fbf-8801-0c3e3738af30 tempest-VolumesListAdminTestJSON-2095154180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:12:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e0eed074-2742-4fbf-8801-0c3e3738af30 tempest-VolumesListAdminTestJSON-2095154180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:54 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:12:54 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:54 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e0eed074-2742-4fbf-8801-0c3e3738af30 tempest-VolumesListAdminTestJSON-2095154180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.404s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:54 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-e0eed074-2742-4fbf-8801-0c3e3738af30 tempest-VolumesListAdminTestJSON-2095154180 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:12:54 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-e0eed074-2742-4fbf-8801-0c3e3738af30 tempest-VolumesListAdminTestJSON-2095154180 None] Deleted volume successfully. Sep 28 18:12:54 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e0eed074-2742-4fbf-8801-0c3e3738af30 tempest-VolumesListAdminTestJSON-2095154180 None] Lock "cinder-af0b4bfc-b0b6-4f78-be90-6701a96102c6-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:12:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "cinder-a582fdd2-2aae-47c1-a031-071670a66161-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-a582fdd2-2aae-47c1-a031-071670a66161-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Performing cascade delete. {{(pid=86980) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 18:12:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "cinder-3b0edee6-c642-429d-b4ae-63e123c3f067-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-3b0edee6-c642-429d-b4ae-63e123c3f067-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "cinder-quobyte-a582fdd2-2aae-47c1-a031-071670a66161" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-quobyte-a582fdd2-2aae-47c1-a031-071670a66161" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "cinder-quobyte-3b0edee6-c642-429d-b4ae-63e123c3f067" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:12:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-quobyte-3b0edee6-c642-429d-b4ae-63e123c3f067" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:12:55 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Deleting offline snapshot 3b0edee6-c642-429d-b4ae-63e123c3f067 of volume a582fdd2-2aae-47c1-a031-071670a66161 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:12:55 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] snapshot_file for this snap is: volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:12:55 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9925b85-9ca9-4ad7-a2a4-41966c697546]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:55 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067 Sep 28 18:12:55 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067" returned: 0 in 0.505s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:55 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a582fdd2-2aae-47c1-a031-071670a66161(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:12:55 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:55 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac2225a-6eb9-4042-aac2-1918d03fc6f3]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:56 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161 Sep 28 18:12:56 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:57 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161" returned: 0 in 1.239s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:57 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e139e7ca-ee24-40b8-8e2a-55dd26c5525d]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.46b39fe8-dba8-4e9a-b0de-4a138b3c0981 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:57 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.46b39fe8-dba8-4e9a-b0de-4a138b3c0981 Sep 28 18:12:57 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:58 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.46b39fe8-dba8-4e9a-b0de-4a138b3c0981" returned: 0 in 0.703s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a582fdd2-2aae-47c1-a031-071670a66161(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:12:58 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8b10e5-21a3-47fd-aa01-dc1c29caf97e]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:58 devstack sudo[97184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067 Sep 28 18:12:58 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:59 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067" returned: 0 in 0.910s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a582fdd2-2aae-47c1-a031-071670a66161(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:12:59 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9aa5571-a82a-4f33-bd48-aa5676bcb8a1]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:12:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:59 devstack sudo[97195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161 Sep 28 18:12:59 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:12:59 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root Sep 28 18:12:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161" returned: 0 in 0.591s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:12:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:12:59 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067 Sep 28 18:12:59 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:00 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067" returned: 0 in 0.646s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:00 devstack sudo[97214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067 Sep 28 18:13:00 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:00 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.3b0edee6-c642-429d-b4ae-63e123c3f067" returned: 0 in 0.517s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a582fdd2-2aae-47c1-a031-071670a66161 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.46b39fe8-dba8-4e9a-b0de-4a138b3c0981 -F qcow2 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:00 devstack sudo[97218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a582fdd2-2aae-47c1-a031-071670a66161 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.46b39fe8-dba8-4e9a-b0de-4a138b3c0981 -F qcow2 Sep 28 18:13:00 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:01 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a582fdd2-2aae-47c1-a031-071670a66161 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.46b39fe8-dba8-4e9a-b0de-4a138b3c0981 -F qcow2" returned: 0 in 0.650s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-quobyte-3b0edee6-c642-429d-b4ae-63e123c3f067" released by "_delete_snapshot" :: held 6.211s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-quobyte-a582fdd2-2aae-47c1-a031-071670a66161" released by "delete_snapshot" :: held 6.263s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:01 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Created reservations ['a5699a11-a6b4-4f3f-86d2-6533242ae3e5', 'bf6d0e4e-0cde-4c13-a21c-039e21aa771c', '3bf62bc1-d2d3-4909-ac8f-0566e29ca766', 'da976452-9c91-45c3-b61a-5d28dfee61e0'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:01 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Delete snapshot completed successfully. Sep 28 18:13:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-3b0edee6-c642-429d-b4ae-63e123c3f067-delete_snapshot" released by "delete_snapshot" :: held 6.583s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "cinder-46b39fe8-dba8-4e9a-b0de-4a138b3c0981-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-46b39fe8-dba8-4e9a-b0de-4a138b3c0981-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "cinder-quobyte-a582fdd2-2aae-47c1-a031-071670a66161" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-quobyte-a582fdd2-2aae-47c1-a031-071670a66161" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "cinder-quobyte-46b39fe8-dba8-4e9a-b0de-4a138b3c0981" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-quobyte-46b39fe8-dba8-4e9a-b0de-4a138b3c0981" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Deleting offline snapshot 46b39fe8-dba8-4e9a-b0de-4a138b3c0981 of volume a582fdd2-2aae-47c1-a031-071670a66161 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:13:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] snapshot_file for this snap is: volume-a582fdd2-2aae-47c1-a031-071670a66161.46b39fe8-dba8-4e9a-b0de-4a138b3c0981 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:13:02 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46da51c-48ac-4fbe-abf9-202486f50c22]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.46b39fe8-dba8-4e9a-b0de-4a138b3c0981 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:02 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.46b39fe8-dba8-4e9a-b0de-4a138b3c0981 Sep 28 18:13:02 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:02 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.46b39fe8-dba8-4e9a-b0de-4a138b3c0981" returned: 0 in 0.861s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a582fdd2-2aae-47c1-a031-071670a66161(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:13:02 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2952ff-3ad5-495a-97be-420a4d611d99]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:03 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:03 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161 Sep 28 18:13:03 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Flow 'volume_create_manager' (992e333c-650f-4e52-a277-049bb7f7fbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2749a07f-14f8-455d-970d-0621ac0a1cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2749a07f-14f8-455d-970d-0621ac0a1cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1363032034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce7c90ba-7950-4c07-b263-50721c079315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22a1fe44f79a46519fcb0b238e16c192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:03Z,use_quota=True,user_id='91f10fdc436d495cbbbf80b57a95a973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2334840b-0822-47e1-969c-7e36db251df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2334840b-0822-47e1-969c-7e36db251df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5afdb0a-e4f7-4a49-9d03-d761e2e623d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5afdb0a-e4f7-4a49-9d03-d761e2e623d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce7c90ba-7950-4c07-b263-50721c079315', 'volume_name': 'volume-ce7c90ba-7950-4c07-b263-50721c079315', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d8d796-be5f-4f77-99d8-8318f4e6cfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d8d796-be5f-4f77-99d8-8318f4e6cfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4894a34d-d587-485b-b99b-fa828c46a349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:03 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Volume ce7c90ba-7950-4c07-b263-50721c079315: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce7c90ba-7950-4c07-b263-50721c079315', 'volume_size': 1} Sep 28 18:13:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1363032034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce7c90ba-7950-4c07-b263-50721c079315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22a1fe44f79a46519fcb0b238e16c192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:03Z,use_quota=True,user_id='91f10fdc436d495cbbbf80b57a95a973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Creating volume ce7c90ba-7950-4c07-b263-50721c079315 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:03 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:13:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ce7c90ba-7950-4c07-b263-50721c079315 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:03 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ce7c90ba-7950-4c07-b263-50721c079315 1073741824 Sep 28 18:13:03 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:03 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161" returned: 0 in 0.678s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.46b39fe8-dba8-4e9a-b0de-4a138b3c0981 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:03 devstack sudo[97263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.46b39fe8-dba8-4e9a-b0de-4a138b3c0981 Sep 28 18:13:03 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:04 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ce7c90ba-7950-4c07-b263-50721c079315 1073741824" returned: 0 in 0.777s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ce7c90ba-7950-4c07-b263-50721c079315 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:04 devstack sudo[97274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ce7c90ba-7950-4c07-b263-50721c079315 Sep 28 18:13:04 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:04 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.46b39fe8-dba8-4e9a-b0de-4a138b3c0981" returned: 0 in 0.670s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.46b39fe8-dba8-4e9a-b0de-4a138b3c0981 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:04 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.46b39fe8-dba8-4e9a-b0de-4a138b3c0981 Sep 28 18:13:04 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:13:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:04 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ce7c90ba-7950-4c07-b263-50721c079315" returned: 0 in 0.471s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:04 devstack sudo[97279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:13:04 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4894a34d-d587-485b-b99b-fa828c46a349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce7c90ba-7950-4c07-b263-50721c079315', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3444760-bf59-473e-8465-1c435a593257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:04 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Volume volume-ce7c90ba-7950-4c07-b263-50721c079315 (ce7c90ba-7950-4c07-b263-50721c079315): created successfully Sep 28 18:13:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3444760-bf59-473e-8465-1c435a593257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Flow 'volume_create_manager' (992e333c-650f-4e52-a277-049bb7f7fbcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:04 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-1563962e-3808-47cf-91ee-e6024b853a3c tempest-AttachVolumeNegativeTest-1060566598 None] Created volume successfully. Sep 28 18:13:04 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161.46b39fe8-dba8-4e9a-b0de-4a138b3c0981" returned: 0 in 0.539s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-quobyte-46b39fe8-dba8-4e9a-b0de-4a138b3c0981" released by "_delete_snapshot" :: held 2.937s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-quobyte-a582fdd2-2aae-47c1-a031-071670a66161" released by "delete_snapshot" :: held 2.965s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:04 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:04 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Created reservations ['b61466d4-26dd-42ef-ad0f-1157ccd6b3e9', '9946b850-1b4b-4fb4-946c-cd9b19f3dcf3', 'c5023465-2173-4650-bbc5-2121d5091118', '26e9d6df-91d1-4e1f-8610-3e0530443c5b'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.425s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:04 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:05 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager._thread_info {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:13:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread count: 28 {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:13:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread info: [<_MainThread(MainThread, started 129097393381504)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:13:05 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Delete snapshot completed successfully. Sep 28 18:13:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-46b39fe8-dba8-4e9a-b0de-4a138b3c0981-delete_snapshot" released by "delete_snapshot" :: held 3.238s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Snapshots deleted, issuing volume delete {{(pid=86980) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 18:13:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "cinder-quobyte-a582fdd2-2aae-47c1-a031-071670a66161" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-quobyte-a582fdd2-2aae-47c1-a031-071670a66161" acquired by "delete_volume" :: waited 0.018s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:05 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bc3248-3189-4b9c-8754-d49e5f169135]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:05 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161 Sep 28 18:13:05 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:05 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161" returned: 0 in 0.507s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:05 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161 Sep 28 18:13:05 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:06 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a582fdd2-2aae-47c1-a031-071670a66161" returned: 0 in 0.411s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-quobyte-a582fdd2-2aae-47c1-a031-071670a66161" released by "delete_volume" :: held 1.020s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:06 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Created reservations ['e0c65b4a-cb70-4bf5-82ce-315b41101ec4', 'c7b50c1e-0ee6-4f14-a11f-c4daa3dd9264', 'cf1dd606-1135-4793-aacc-c90512c7a0bd', 'f9c11113-1c06-427b-8c58-f1d93cf98642'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:06 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:13:06 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-aa243cdf-19db-4e5f-9f44-0c173375560a req-022d57c3-7fe6-443a-9aeb-a62a2ec550e9 tempest-AttachVolumeNegativeTest-1060566598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-aa243cdf-19db-4e5f-9f44-0c173375560a req-022d57c3-7fe6-443a-9aeb-a62a2ec550e9 tempest-AttachVolumeNegativeTest-1060566598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-aa243cdf-19db-4e5f-9f44-0c173375560a req-022d57c3-7fe6-443a-9aeb-a62a2ec550e9 tempest-AttachVolumeNegativeTest-1060566598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-aa243cdf-19db-4e5f-9f44-0c173375560a req-022d57c3-7fe6-443a-9aeb-a62a2ec550e9 tempest-AttachVolumeNegativeTest-1060566598 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729', 'name': 'volume-ce7c90ba-7950-4c07-b263-50721c079315', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ffabb14b-39cb-4c04-9208-9753394b8f25', 'enforce_multipath': True} {{(pid=86980) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:13:06 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-aa243cdf-19db-4e5f-9f44-0c173375560a req-022d57c3-7fe6-443a-9aeb-a62a2ec550e9 tempest-AttachVolumeNegativeTest-1060566598 None] attachment_update completed successfully. Sep 28 18:13:06 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.402s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:06 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:06 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Deleted volume successfully. Sep 28 18:13:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-461bd3da-6d6a-4e37-8b2d-bc19a0465442 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-a582fdd2-2aae-47c1-a031-071670a66161-delete_volume" released by "delete_volume" :: held 11.640s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:07 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Flow 'volume_create_manager' (dba8a99a-836d-4256-8065-ef083f4433e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e04898f-2438-4aa3-9cb6-e2d5c17ded32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e04898f-2438-4aa3-9cb6-e2d5c17ded32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-820382557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463c0c7e-ec3e-4742-b8e5-84bc8ec9ac6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f16ed0d1f0495ab87ef2be0f285a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:08Z,use_quota=True,user_id='d1c4f5c7f22948ce84ab82224607c2f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b61c308f-b7db-4299-a032-01fd81180921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b61c308f-b7db-4299-a032-01fd81180921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ac5e42-d07e-4464-a27d-3c655f914836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ac5e42-d07e-4464-a27d-3c655f914836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '463c0c7e-ec3e-4742-b8e5-84bc8ec9ac6a', 'volume_name': 'volume-463c0c7e-ec3e-4742-b8e5-84bc8ec9ac6a', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e86d15e-42d6-4388-9d7c-e3a85abcb2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e86d15e-42d6-4388-9d7c-e3a85abcb2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95489e34-8df8-49d9-860d-330ba9dc85bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:07 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Volume 463c0c7e-ec3e-4742-b8e5-84bc8ec9ac6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-463c0c7e-ec3e-4742-b8e5-84bc8ec9ac6a', 'volume_size': 1} Sep 28 18:13:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-820382557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463c0c7e-ec3e-4742-b8e5-84bc8ec9ac6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f16ed0d1f0495ab87ef2be0f285a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:08Z,use_quota=True,user_id='d1c4f5c7f22948ce84ab82224607c2f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Creating volume 463c0c7e-ec3e-4742-b8e5-84bc8ec9ac6a {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:07 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:13:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-463c0c7e-ec3e-4742-b8e5-84bc8ec9ac6a 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:07 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-463c0c7e-ec3e-4742-b8e5-84bc8ec9ac6a 1073741824 Sep 28 18:13:07 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:08 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Flow 'volume_create_manager' (fbb54cd2-1246-422e-ad09-117e994663bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d76676-dd7a-4933-8119-7d4edefd104c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d76676-dd7a-4933-8119-7d4edefd104c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1777930722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c93ae60c-a93d-4086-af35-1325728f3eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='720456a053fe49729b81f1861ec91fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:08Z,use_quota=True,user_id='182f5d2495e64abf962432e9e0157fbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25b04ea6-8042-413e-bdbd-0bfdbae4d65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25b04ea6-8042-413e-bdbd-0bfdbae4d65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da6f646-a4d9-47ab-9f1f-71b2868d9c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da6f646-a4d9-47ab-9f1f-71b2868d9c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c93ae60c-a93d-4086-af35-1325728f3eca', 'volume_name': 'volume-c93ae60c-a93d-4086-af35-1325728f3eca', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f349c0a-9168-4114-bfcf-5e749756a747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f349c0a-9168-4114-bfcf-5e749756a747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f80daf0f-8b77-4cad-b930-897a216a15c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:08 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Volume c93ae60c-a93d-4086-af35-1325728f3eca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c93ae60c-a93d-4086-af35-1325728f3eca', 'volume_size': 1} Sep 28 18:13:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:08 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-463c0c7e-ec3e-4742-b8e5-84bc8ec9ac6a 1073741824" returned: 0 in 0.790s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-463c0c7e-ec3e-4742-b8e5-84bc8ec9ac6a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:08 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-463c0c7e-ec3e-4742-b8e5-84bc8ec9ac6a Sep 28 18:13:08 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:09 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-463c0c7e-ec3e-4742-b8e5-84bc8ec9ac6a" returned: 0 in 0.326s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.657s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1777930722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c93ae60c-a93d-4086-af35-1325728f3eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='720456a053fe49729b81f1861ec91fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:08Z,use_quota=True,user_id='182f5d2495e64abf962432e9e0157fbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Creating volume c93ae60c-a93d-4086-af35-1325728f3eca {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:09 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:13:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95489e34-8df8-49d9-860d-330ba9dc85bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-463c0c7e-ec3e-4742-b8e5-84bc8ec9ac6a', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5d6acf-36d3-490b-a7f5-38cc5cf3e30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:09 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca 1073741824 Sep 28 18:13:09 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:09 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Volume volume-463c0c7e-ec3e-4742-b8e5-84bc8ec9ac6a (463c0c7e-ec3e-4742-b8e5-84bc8ec9ac6a): created successfully Sep 28 18:13:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5d6acf-36d3-490b-a7f5-38cc5cf3e30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Flow 'volume_create_manager' (dba8a99a-836d-4256-8065-ef083f4433e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:09 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-c966f02a-4d11-451f-8408-b14ce8b9fb2d tempest-VolumesTransfersTest-1605364017 None] Created volume successfully. Sep 28 18:13:09 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca 1073741824" returned: 0 in 0.719s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:09 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca Sep 28 18:13:09 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:10 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca" returned: 0 in 0.478s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:10 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:10 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f80daf0f-8b77-4cad-b930-897a216a15c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c93ae60c-a93d-4086-af35-1325728f3eca', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:10 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d5a5878-9665-4997-8727-12198f205d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:10 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Volume volume-c93ae60c-a93d-4086-af35-1325728f3eca (c93ae60c-a93d-4086-af35-1325728f3eca): created successfully Sep 28 18:13:10 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d5a5878-9665-4997-8727-12198f205d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:10 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Flow 'volume_create_manager' (fbb54cd2-1246-422e-ad09-117e994663bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:10 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-a16f460a-f43e-4554-a2f0-c850da983e51 tempest-VolumesDeleteCascade-1502592551 None] Created volume successfully. Sep 28 18:13:10 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-2e7f88f3-c3d9-47ee-9c65-a9616a5fd54a tempest-VolumesTransfersTest-1421436324 None] Transfer volume completed successfully. Sep 28 18:13:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-814abe19-3cb7-4cef-8fe4-391fc7878c46 tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-814abe19-3cb7-4cef-8fe4-391fc7878c46 tempest-VolumesDeleteCascade-1502592551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:11 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-814abe19-3cb7-4cef-8fe4-391fc7878c46 tempest-VolumesDeleteCascade-1502592551 None] Creating offline snapshot d0ea145c-85d8-479b-a4d1-9af8ad1835ae of volume c93ae60c-a93d-4086-af35-1325728f3eca {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:13:11 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f66ad4-dcca-4730-a8ef-caec77d5b5e2]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-814abe19-3cb7-4cef-8fe4-391fc7878c46 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:11 devstack sudo[97747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca Sep 28 18:13:11 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:11 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-814abe19-3cb7-4cef-8fe4-391fc7878c46 tempest-VolumesDeleteCascade-1502592551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca" returned: 0 in 0.680s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-814abe19-3cb7-4cef-8fe4-391fc7878c46 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca.d0ea145c-85d8-479b-a4d1-9af8ad1835ae 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:11 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca.d0ea145c-85d8-479b-a4d1-9af8ad1835ae 1G Sep 28 18:13:11 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:11 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-06ad27be-2c99-409a-88df-2243436744b3 tempest-VolumesTransfersTest-2012219331 None] Acquiring lock "cinder-463c0c7e-ec3e-4742-b8e5-84bc8ec9ac6a-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:11 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-06ad27be-2c99-409a-88df-2243436744b3 tempest-VolumesTransfersTest-2012219331 None] Lock "cinder-463c0c7e-ec3e-4742-b8e5-84bc8ec9ac6a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:12 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-06ad27be-2c99-409a-88df-2243436744b3 tempest-VolumesTransfersTest-2012219331 None] Acquiring lock "cinder-quobyte-463c0c7e-ec3e-4742-b8e5-84bc8ec9ac6a" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:12 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-06ad27be-2c99-409a-88df-2243436744b3 tempest-VolumesTransfersTest-2012219331 None] Lock "cinder-quobyte-463c0c7e-ec3e-4742-b8e5-84bc8ec9ac6a" acquired by "delete_volume" :: waited 0.038s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:12 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[087363f0-1bec-4323-9e09-2ad564f67f4a]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-06ad27be-2c99-409a-88df-2243436744b3 tempest-VolumesTransfersTest-2012219331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-463c0c7e-ec3e-4742-b8e5-84bc8ec9ac6a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:12 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-463c0c7e-ec3e-4742-b8e5-84bc8ec9ac6a Sep 28 18:13:12 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:12 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-814abe19-3cb7-4cef-8fe4-391fc7878c46 tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca.d0ea145c-85d8-479b-a4d1-9af8ad1835ae 1G" returned: 0 in 0.709s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-814abe19-3cb7-4cef-8fe4-391fc7878c46 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c93ae60c-a93d-4086-af35-1325728f3eca -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca.d0ea145c-85d8-479b-a4d1-9af8ad1835ae {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:12 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c93ae60c-a93d-4086-af35-1325728f3eca -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca.d0ea145c-85d8-479b-a4d1-9af8ad1835ae Sep 28 18:13:12 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:12 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-06ad27be-2c99-409a-88df-2243436744b3 tempest-VolumesTransfersTest-2012219331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-463c0c7e-ec3e-4742-b8e5-84bc8ec9ac6a" returned: 0 in 0.629s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-06ad27be-2c99-409a-88df-2243436744b3 tempest-VolumesTransfersTest-2012219331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-463c0c7e-ec3e-4742-b8e5-84bc8ec9ac6a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:12 devstack sudo[97765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-463c0c7e-ec3e-4742-b8e5-84bc8ec9ac6a Sep 28 18:13:12 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:12 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-814abe19-3cb7-4cef-8fe4-391fc7878c46 tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c93ae60c-a93d-4086-af35-1325728f3eca -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca.d0ea145c-85d8-479b-a4d1-9af8ad1835ae" returned: 0 in 0.494s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:12 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-814abe19-3cb7-4cef-8fe4-391fc7878c46 tempest-VolumesDeleteCascade-1502592551 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca.d0ea145c-85d8-479b-a4d1-9af8ad1835ae is being set with open permissions: ugo+rw Sep 28 18:13:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-814abe19-3cb7-4cef-8fe4-391fc7878c46 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca.d0ea145c-85d8-479b-a4d1-9af8ad1835ae {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:13 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca.d0ea145c-85d8-479b-a4d1-9af8ad1835ae Sep 28 18:13:13 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:13 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-06ad27be-2c99-409a-88df-2243436744b3 tempest-VolumesTransfersTest-2012219331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-463c0c7e-ec3e-4742-b8e5-84bc8ec9ac6a" returned: 0 in 0.450s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:13 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-06ad27be-2c99-409a-88df-2243436744b3 tempest-VolumesTransfersTest-2012219331 None] Lock "cinder-quobyte-463c0c7e-ec3e-4742-b8e5-84bc8ec9ac6a" released by "delete_volume" :: held 1.169s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:13 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-06ad27be-2c99-409a-88df-2243436744b3 tempest-VolumesTransfersTest-2012219331 None] Created reservations ['984254c8-97c5-4d00-bc4e-2e125d187773', '7a8a9461-3c57-4a6e-a7f2-51cd556a3d41', 'ad7cdd7e-b749-445b-bd70-9f58dff52b3d', '082301fd-cdb3-404c-9c2c-19dfc5eb81f9'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:13 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-814abe19-3cb7-4cef-8fe4-391fc7878c46 tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca.d0ea145c-85d8-479b-a4d1-9af8ad1835ae" returned: 0 in 0.546s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-06ad27be-2c99-409a-88df-2243436744b3 tempest-VolumesTransfersTest-2012219331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-06ad27be-2c99-409a-88df-2243436744b3 tempest-VolumesTransfersTest-2012219331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:13 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-06ad27be-2c99-409a-88df-2243436744b3 tempest-VolumesTransfersTest-2012219331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:13 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-06ad27be-2c99-409a-88df-2243436744b3 tempest-VolumesTransfersTest-2012219331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-06ad27be-2c99-409a-88df-2243436744b3 tempest-VolumesTransfersTest-2012219331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-06ad27be-2c99-409a-88df-2243436744b3 tempest-VolumesTransfersTest-2012219331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:13 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:13:13 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-814abe19-3cb7-4cef-8fe4-391fc7878c46 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:13 devstack sudo[97779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca.info Sep 28 18:13:13 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:13 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-06ad27be-2c99-409a-88df-2243436744b3 tempest-VolumesTransfersTest-2012219331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.342s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:13 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-06ad27be-2c99-409a-88df-2243436744b3 tempest-VolumesTransfersTest-2012219331 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:13 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-06ad27be-2c99-409a-88df-2243436744b3 tempest-VolumesTransfersTest-2012219331 None] Deleted volume successfully. Sep 28 18:13:13 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-06ad27be-2c99-409a-88df-2243436744b3 tempest-VolumesTransfersTest-2012219331 None] Lock "cinder-463c0c7e-ec3e-4742-b8e5-84bc8ec9ac6a-delete_volume" released by "delete_volume" :: held 2.072s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:14 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-814abe19-3cb7-4cef-8fe4-391fc7878c46 tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca.info" returned: 0 in 0.470s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:14 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-814abe19-3cb7-4cef-8fe4-391fc7878c46 tempest-VolumesDeleteCascade-1502592551 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca.info is being set with open permissions: ugo+rw Sep 28 18:13:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-814abe19-3cb7-4cef-8fe4-391fc7878c46 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:14 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca.info Sep 28 18:13:14 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:14 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-814abe19-3cb7-4cef-8fe4-391fc7878c46 tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca.info" returned: 0 in 0.358s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-814abe19-3cb7-4cef-8fe4-391fc7878c46 tempest-VolumesDeleteCascade-1502592551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.484s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:14 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-814abe19-3cb7-4cef-8fe4-391fc7878c46 tempest-VolumesDeleteCascade-1502592551 None] Create snapshot completed successfully Sep 28 18:13:15 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Flow 'volume_create_manager' (1eccd700-f5d7-46d5-adab-3b67ee1d0558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb5102a-ba98-4a92-8f49-bc574a50fb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb5102a-ba98-4a92-8f49-bc574a50fb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1500081304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944db29e-a796-4950-a3bd-c1e0efbeea54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f16ed0d1f0495ab87ef2be0f285a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:15Z,use_quota=True,user_id='d1c4f5c7f22948ce84ab82224607c2f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f469d215-d358-43b1-8eff-a5306394f2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f469d215-d358-43b1-8eff-a5306394f2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d85835-c897-493a-a78e-57552db4abc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d85835-c897-493a-a78e-57552db4abc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '944db29e-a796-4950-a3bd-c1e0efbeea54', 'volume_name': 'volume-944db29e-a796-4950-a3bd-c1e0efbeea54', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0c13f0-9f89-48d9-9f1c-cb4200c39e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0c13f0-9f89-48d9-9f1c-cb4200c39e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d199172-d6e6-4664-9858-5b4b55b60620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:15 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Volume 944db29e-a796-4950-a3bd-c1e0efbeea54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-944db29e-a796-4950-a3bd-c1e0efbeea54', 'volume_size': 1} Sep 28 18:13:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:15 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1500081304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944db29e-a796-4950-a3bd-c1e0efbeea54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19f16ed0d1f0495ab87ef2be0f285a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:15Z,use_quota=True,user_id='d1c4f5c7f22948ce84ab82224607c2f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:15 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Creating volume 944db29e-a796-4950-a3bd-c1e0efbeea54 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:15 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:15 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:15 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:15 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:13:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-944db29e-a796-4950-a3bd-c1e0efbeea54 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:15 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-944db29e-a796-4950-a3bd-c1e0efbeea54 1073741824 Sep 28 18:13:15 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:16 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-944db29e-a796-4950-a3bd-c1e0efbeea54 1073741824" returned: 0 in 0.838s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-944db29e-a796-4950-a3bd-c1e0efbeea54 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:16 devstack sudo[97793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-944db29e-a796-4950-a3bd-c1e0efbeea54 Sep 28 18:13:16 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:16 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-944db29e-a796-4950-a3bd-c1e0efbeea54" returned: 0 in 0.491s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d199172-d6e6-4664-9858-5b4b55b60620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-944db29e-a796-4950-a3bd-c1e0efbeea54', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d5ea886-7654-4288-81ed-786c05cc1a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:16 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Volume volume-944db29e-a796-4950-a3bd-c1e0efbeea54 (944db29e-a796-4950-a3bd-c1e0efbeea54): created successfully Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d5ea886-7654-4288-81ed-786c05cc1a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Flow 'volume_create_manager' (1eccd700-f5d7-46d5-adab-3b67ee1d0558) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Flow 'volume_create_manager' (81940d54-5c7d-4afb-b570-ce9b24f7c69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e6fbc22-a7da-4415-b927-ea610f9dba83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:16 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-b56b4a95-f273-4cd9-a0ef-111f4d422e26 tempest-VolumesTransfersTest-1605364017 None] Created volume successfully. Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e6fbc22-a7da-4415-b927-ea610f9dba83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-830077116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1da7367-9025-4df0-bacc-4eca8f5074b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='720456a053fe49729b81f1861ec91fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d0ea145c-85d8-479b-a4d1-9af8ad1835ae,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:17Z,use_quota=True,user_id='182f5d2495e64abf962432e9e0157fbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a7f1bd2-65cb-46ae-adbd-e5844a5b80be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a7f1bd2-65cb-46ae-adbd-e5844a5b80be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f1034b8-ee00-4b68-92ca-983b69019a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f1034b8-ee00-4b68-92ca-983b69019a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a1da7367-9025-4df0-bacc-4eca8f5074b7', 'volume_name': 'volume-a1da7367-9025-4df0-bacc-4eca8f5074b7', 'volume_size': 1, 'snapshot_id': 'd0ea145c-85d8-479b-a4d1-9af8ad1835ae'}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d518472-d914-4b96-a0dd-f22ff1077ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d518472-d914-4b96-a0dd-f22ff1077ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eab0c2d-36d4-48fb-b15d-0e989bfd23bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:16 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Volume a1da7367-9025-4df0-bacc-4eca8f5074b7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a1da7367-9025-4df0-bacc-4eca8f5074b7', 'volume_size': 1, 'snapshot_id': 'd0ea145c-85d8-479b-a4d1-9af8ad1835ae'} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "cinder-quobyte-d0ea145c-85d8-479b-a4d1-9af8ad1835ae-a1da7367-9025-4df0-bacc-4eca8f5074b7" by "_create_volume_from_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-quobyte-d0ea145c-85d8-479b-a4d1-9af8ad1835ae-a1da7367-9025-4df0-bacc-4eca8f5074b7" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Creating volume a1da7367-9025-4df0-bacc-4eca8f5074b7 from snapshot d0ea145c-85d8-479b-a4d1-9af8ad1835ae {{(pid=86980) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "cinder-quobyte-a1da7367-9025-4df0-bacc-4eca8f5074b7" by "_copy_volume_from_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-quobyte-a1da7367-9025-4df0-bacc-4eca8f5074b7" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] snapshot: d0ea145c-85d8-479b-a4d1-9af8ad1835ae, volume: a1da7367-9025-4df0-bacc-4eca8f5074b7, {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:13:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:17 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:17 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:17 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-7ba166e2-3ece-40e2-8081-4ac965896f59 tempest-VolumesNegativeTest-1732955512 None] Acquiring lock "cinder-88d905c1-37fd-480d-b700-f883aa7bf536-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:17 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-7ba166e2-3ece-40e2-8081-4ac965896f59 tempest-VolumesNegativeTest-1732955512 None] Lock "cinder-88d905c1-37fd-480d-b700-f883aa7bf536-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:17 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef86f2ae-5b5f-4499-be6b-c4f7d0d81177]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca.d0ea145c-85d8-479b-a4d1-9af8ad1835ae {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:17 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-7ba166e2-3ece-40e2-8081-4ac965896f59 tempest-VolumesNegativeTest-1732955512 None] Acquiring lock "cinder-quobyte-88d905c1-37fd-480d-b700-f883aa7bf536" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:17 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-7ba166e2-3ece-40e2-8081-4ac965896f59 tempest-VolumesNegativeTest-1732955512 None] Lock "cinder-quobyte-88d905c1-37fd-480d-b700-f883aa7bf536" acquired by "delete_volume" :: waited 0.048s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:17 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a6ced3-866a-40cb-801a-43a3550a2d43]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7ba166e2-3ece-40e2-8081-4ac965896f59 tempest-VolumesNegativeTest-1732955512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88d905c1-37fd-480d-b700-f883aa7bf536 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:17 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca.d0ea145c-85d8-479b-a4d1-9af8ad1835ae Sep 28 18:13:17 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:17 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88d905c1-37fd-480d-b700-f883aa7bf536 Sep 28 18:13:17 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:17 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9001cf4e-08e6-4e82-9fcb-2e65bd6bb8cb tempest-VolumesTransfersTest-2012219331 None] Acquiring lock "cinder-944db29e-a796-4950-a3bd-c1e0efbeea54-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:17 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9001cf4e-08e6-4e82-9fcb-2e65bd6bb8cb tempest-VolumesTransfersTest-2012219331 None] Lock "cinder-944db29e-a796-4950-a3bd-c1e0efbeea54-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:17 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca.d0ea145c-85d8-479b-a4d1-9af8ad1835ae" returned: 0 in 0.790s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:17 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c93ae60c-a93d-4086-af35-1325728f3eca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:13:17 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[60adf06d-09f5-4134-ae2c-8d2ac75a37d4]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:17 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9001cf4e-08e6-4e82-9fcb-2e65bd6bb8cb tempest-VolumesTransfersTest-2012219331 None] Acquiring lock "cinder-quobyte-944db29e-a796-4950-a3bd-c1e0efbeea54" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:17 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7ba166e2-3ece-40e2-8081-4ac965896f59 tempest-VolumesNegativeTest-1732955512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88d905c1-37fd-480d-b700-f883aa7bf536" returned: 0 in 0.634s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7ba166e2-3ece-40e2-8081-4ac965896f59 tempest-VolumesNegativeTest-1732955512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88d905c1-37fd-480d-b700-f883aa7bf536 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:17 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9001cf4e-08e6-4e82-9fcb-2e65bd6bb8cb tempest-VolumesTransfersTest-2012219331 None] Lock "cinder-quobyte-944db29e-a796-4950-a3bd-c1e0efbeea54" acquired by "delete_volume" :: waited 0.038s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:18 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88d905c1-37fd-480d-b700-f883aa7bf536 Sep 28 18:13:18 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:18 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee14278-8202-47fa-a497-d9659112921d]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9001cf4e-08e6-4e82-9fcb-2e65bd6bb8cb tempest-VolumesTransfersTest-2012219331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-944db29e-a796-4950-a3bd-c1e0efbeea54 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:18 devstack sudo[97823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca Sep 28 18:13:18 devstack sudo[97823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:18 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-944db29e-a796-4950-a3bd-c1e0efbeea54 Sep 28 18:13:18 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:18 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7ba166e2-3ece-40e2-8081-4ac965896f59 tempest-VolumesNegativeTest-1732955512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88d905c1-37fd-480d-b700-f883aa7bf536" returned: 0 in 0.461s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-7ba166e2-3ece-40e2-8081-4ac965896f59 tempest-VolumesNegativeTest-1732955512 None] Lock "cinder-quobyte-88d905c1-37fd-480d-b700-f883aa7bf536" released by "delete_volume" :: held 1.208s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:18 devstack sudo[97823]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca" returned: 0 in 0.563s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:13:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Creating direct copy from snapshot {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:13:18 devstack cinder-volume[86980]: DEBUG cinder.utils [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Path /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a1da7367-9025-4df0-bacc-4eca8f5074b7 not found in is_blk_device check {{(pid=86980) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:13:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a1da7367-9025-4df0-bacc-4eca8f5074b7 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:18 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9001cf4e-08e6-4e82-9fcb-2e65bd6bb8cb tempest-VolumesTransfersTest-2012219331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-944db29e-a796-4950-a3bd-c1e0efbeea54" returned: 0 in 0.481s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9001cf4e-08e6-4e82-9fcb-2e65bd6bb8cb tempest-VolumesTransfersTest-2012219331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-944db29e-a796-4950-a3bd-c1e0efbeea54 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:18 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a1da7367-9025-4df0-bacc-4eca8f5074b7 Sep 28 18:13:18 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:18 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-944db29e-a796-4950-a3bd-c1e0efbeea54 Sep 28 18:13:18 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:18 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-7ba166e2-3ece-40e2-8081-4ac965896f59 tempest-VolumesNegativeTest-1732955512 None] Created reservations ['da5d1528-4542-4682-83c0-9a4c96a35819', 'ac712950-ee00-4ad5-8d07-162efb30a37a', '2c137498-02f0-4723-8850-85dcc7ef26a3', 'bdc6859c-ef48-4665-b041-da90206f7b2f'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7ba166e2-3ece-40e2-8081-4ac965896f59 tempest-VolumesNegativeTest-1732955512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7ba166e2-3ece-40e2-8081-4ac965896f59 tempest-VolumesNegativeTest-1732955512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-7ba166e2-3ece-40e2-8081-4ac965896f59 tempest-VolumesNegativeTest-1732955512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-7ba166e2-3ece-40e2-8081-4ac965896f59 tempest-VolumesNegativeTest-1732955512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7ba166e2-3ece-40e2-8081-4ac965896f59 tempest-VolumesNegativeTest-1732955512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7ba166e2-3ece-40e2-8081-4ac965896f59 tempest-VolumesNegativeTest-1732955512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:18 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:13:18 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:18 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9001cf4e-08e6-4e82-9fcb-2e65bd6bb8cb tempest-VolumesTransfersTest-2012219331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-944db29e-a796-4950-a3bd-c1e0efbeea54" returned: 0 in 0.404s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9001cf4e-08e6-4e82-9fcb-2e65bd6bb8cb tempest-VolumesTransfersTest-2012219331 None] Lock "cinder-quobyte-944db29e-a796-4950-a3bd-c1e0efbeea54" released by "delete_volume" :: held 0.989s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:19 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-9001cf4e-08e6-4e82-9fcb-2e65bd6bb8cb tempest-VolumesTransfersTest-2012219331 None] Created reservations ['74b73b0c-8a01-41db-9577-a80cb24ca163', 'fea9ac9d-07fe-47f6-ba40-6097b2b5990e', 'b2bea7fd-c431-4617-9904-821b3914d0b2', 'eb47c885-9129-44e5-9a9d-b9fc45f0ae4f'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:19 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7ba166e2-3ece-40e2-8081-4ac965896f59 tempest-VolumesNegativeTest-1732955512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.452s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:19 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-7ba166e2-3ece-40e2-8081-4ac965896f59 tempest-VolumesNegativeTest-1732955512 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:19 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-7ba166e2-3ece-40e2-8081-4ac965896f59 tempest-VolumesNegativeTest-1732955512 None] Deleted volume successfully. Sep 28 18:13:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-9001cf4e-08e6-4e82-9fcb-2e65bd6bb8cb tempest-VolumesTransfersTest-2012219331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-9001cf4e-08e6-4e82-9fcb-2e65bd6bb8cb tempest-VolumesTransfersTest-2012219331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-9001cf4e-08e6-4e82-9fcb-2e65bd6bb8cb tempest-VolumesTransfersTest-2012219331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-9001cf4e-08e6-4e82-9fcb-2e65bd6bb8cb tempest-VolumesTransfersTest-2012219331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-9001cf4e-08e6-4e82-9fcb-2e65bd6bb8cb tempest-VolumesTransfersTest-2012219331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9001cf4e-08e6-4e82-9fcb-2e65bd6bb8cb tempest-VolumesTransfersTest-2012219331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:19 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-7ba166e2-3ece-40e2-8081-4ac965896f59 tempest-VolumesNegativeTest-1732955512 None] Lock "cinder-88d905c1-37fd-480d-b700-f883aa7bf536-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:19 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:13:19 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:19 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9001cf4e-08e6-4e82-9fcb-2e65bd6bb8cb tempest-VolumesTransfersTest-2012219331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.400s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:19 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-9001cf4e-08e6-4e82-9fcb-2e65bd6bb8cb tempest-VolumesTransfersTest-2012219331 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:19 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-9001cf4e-08e6-4e82-9fcb-2e65bd6bb8cb tempest-VolumesTransfersTest-2012219331 None] Deleted volume successfully. Sep 28 18:13:19 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9001cf4e-08e6-4e82-9fcb-2e65bd6bb8cb tempest-VolumesTransfersTest-2012219331 None] Lock "cinder-944db29e-a796-4950-a3bd-c1e0efbeea54-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:29 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=77,cinder:INSERT=18,cinder:UPDATE=100,cinder:DELETE=7 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:13:29 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:UPDATE=90,cinder:SELECT=78,cinder:DELETE=9,cinder:INSERT=29 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:13:30 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a1da7367-9025-4df0-bacc-4eca8f5074b7" returned: 0 in 11.967s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:30 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Image conversion details: src /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca, size 1024.00 MB, duration 11.97 sec, destination /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a1da7367-9025-4df0-bacc-4eca8f5074b7 {{(pid=86980) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:13:30 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Converted 1024.00 MB image at 85.56 MB/s Sep 28 18:13:30 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a1da7367-9025-4df0-bacc-4eca8f5074b7 is being set with open permissions: ugo+rw Sep 28 18:13:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a1da7367-9025-4df0-bacc-4eca8f5074b7 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:30 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a1da7367-9025-4df0-bacc-4eca8f5074b7 Sep 28 18:13:30 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:30 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a1da7367-9025-4df0-bacc-4eca8f5074b7" returned: 0 in 0.385s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:30 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-quobyte-a1da7367-9025-4df0-bacc-4eca8f5074b7" released by "_copy_volume_from_snapshot" :: held 13.875s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:30 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-quobyte-d0ea145c-85d8-479b-a4d1-9af8ad1835ae-a1da7367-9025-4df0-bacc-4eca8f5074b7" released by "_create_volume_from_snapshot" :: held 13.998s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.018s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:30 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eab0c2d-36d4-48fb-b15d-0e989bfd23bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1da7367-9025-4df0-bacc-4eca8f5074b7', 'volume_size': 1, 'snapshot_id': 'd0ea145c-85d8-479b-a4d1-9af8ad1835ae'}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:30 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155bd6cb-16b3-40e6-89d9-05f11e22dc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:31 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Volume volume-a1da7367-9025-4df0-bacc-4eca8f5074b7 (a1da7367-9025-4df0-bacc-4eca8f5074b7): created successfully Sep 28 18:13:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155bd6cb-16b3-40e6-89d9-05f11e22dc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Flow 'volume_create_manager' (81940d54-5c7d-4afb-b570-ce9b24f7c69a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:31 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-a621f503-a572-49b0-bd1d-6e866c9d3e1d tempest-VolumesDeleteCascade-1502592551 None] Created volume successfully. Sep 28 18:13:32 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "cinder-c93ae60c-a93d-4086-af35-1325728f3eca-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:32 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-c93ae60c-a93d-4086-af35-1325728f3eca-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:32 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Performing cascade delete. {{(pid=86980) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 18:13:32 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "cinder-d0ea145c-85d8-479b-a4d1-9af8ad1835ae-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:32 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-d0ea145c-85d8-479b-a4d1-9af8ad1835ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:32 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "cinder-quobyte-c93ae60c-a93d-4086-af35-1325728f3eca" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:32 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-quobyte-c93ae60c-a93d-4086-af35-1325728f3eca" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:32 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "cinder-quobyte-d0ea145c-85d8-479b-a4d1-9af8ad1835ae" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:32 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-quobyte-d0ea145c-85d8-479b-a4d1-9af8ad1835ae" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:32 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Deleting offline snapshot d0ea145c-85d8-479b-a4d1-9af8ad1835ae of volume c93ae60c-a93d-4086-af35-1325728f3eca {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:13:32 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] snapshot_file for this snap is: volume-c93ae60c-a93d-4086-af35-1325728f3eca.d0ea145c-85d8-479b-a4d1-9af8ad1835ae {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:13:32 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[12748f5b-7eee-4daa-9ede-b60963ad6e2d]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca.d0ea145c-85d8-479b-a4d1-9af8ad1835ae {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:32 devstack sudo[97958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca.d0ea145c-85d8-479b-a4d1-9af8ad1835ae Sep 28 18:13:32 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:33 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca.d0ea145c-85d8-479b-a4d1-9af8ad1835ae" returned: 0 in 0.705s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c93ae60c-a93d-4086-af35-1325728f3eca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:13:33 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[85662a7c-bb0b-46ee-9ad0-e151d3b5f122]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:33 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca Sep 28 18:13:33 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:34 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca" returned: 0 in 0.849s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca.d0ea145c-85d8-479b-a4d1-9af8ad1835ae {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:34 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca.d0ea145c-85d8-479b-a4d1-9af8ad1835ae Sep 28 18:13:34 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:34 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca.d0ea145c-85d8-479b-a4d1-9af8ad1835ae" returned: 0 in 0.696s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca.d0ea145c-85d8-479b-a4d1-9af8ad1835ae {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:34 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca.d0ea145c-85d8-479b-a4d1-9af8ad1835ae Sep 28 18:13:34 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:35 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca.d0ea145c-85d8-479b-a4d1-9af8ad1835ae" returned: 0 in 0.394s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:35 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-quobyte-d0ea145c-85d8-479b-a4d1-9af8ad1835ae" released by "_delete_snapshot" :: held 2.846s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:35 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-quobyte-c93ae60c-a93d-4086-af35-1325728f3eca" released by "delete_snapshot" :: held 2.881s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:35 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Created reservations ['1f9efbaf-b97e-402c-a069-6d6e98e550a4', '1753ca08-91fe-461a-92f0-523f7b40935a', 'cc4c8ad2-f537-4a7a-926e-c15bf5effb70', 'abc19648-cb05-4b76-bfe7-920be2a5bf60'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:35 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Delete snapshot completed successfully. Sep 28 18:13:35 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-d0ea145c-85d8-479b-a4d1-9af8ad1835ae-delete_snapshot" released by "delete_snapshot" :: held 3.228s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Snapshots deleted, issuing volume delete {{(pid=86980) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 18:13:35 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "cinder-quobyte-c93ae60c-a93d-4086-af35-1325728f3eca" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:35 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-quobyte-c93ae60c-a93d-4086-af35-1325728f3eca" acquired by "delete_volume" :: waited 0.027s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:35 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[857437e3-9b62-4e4c-8293-4476eb4d01a4]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:35 devstack sudo[97978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca Sep 28 18:13:35 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:36 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca" returned: 0 in 0.549s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:36 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca Sep 28 18:13:36 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:36 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c93ae60c-a93d-4086-af35-1325728f3eca" returned: 0 in 0.548s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:36 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-quobyte-c93ae60c-a93d-4086-af35-1325728f3eca" released by "delete_volume" :: held 1.261s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:36 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Created reservations ['45bfec9a-8127-4975-a383-046981c2f1b7', '86774be5-1584-4da3-84fe-6a2ee539c7f6', '0db76597-6543-4c93-b022-27a1350a7241', 'a79711f7-88cb-4cee-a7e9-43ec8396c85c'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:37 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:13:37 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:37 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.362s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:37 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:37 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Deleted volume successfully. Sep 28 18:13:37 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c9635ca3-e5d8-4486-ac6c-111e1a33e416 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-c93ae60c-a93d-4086-af35-1325728f3eca-delete_volume" released by "delete_volume" :: held 5.315s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:38 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-7ba9aa92-33e5-4f91-92ca-a8418e96b668 tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "cinder-a1da7367-9025-4df0-bacc-4eca8f5074b7-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:38 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-7ba9aa92-33e5-4f91-92ca-a8418e96b668 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-a1da7367-9025-4df0-bacc-4eca8f5074b7-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:38 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-7ba9aa92-33e5-4f91-92ca-a8418e96b668 tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "cinder-quobyte-a1da7367-9025-4df0-bacc-4eca8f5074b7" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:38 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-7ba9aa92-33e5-4f91-92ca-a8418e96b668 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-quobyte-a1da7367-9025-4df0-bacc-4eca8f5074b7" acquired by "delete_volume" :: waited 0.020s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:38 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac79c9e-64e8-48f6-8425-851fd19eff39]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7ba9aa92-33e5-4f91-92ca-a8418e96b668 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a1da7367-9025-4df0-bacc-4eca8f5074b7 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:38 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a1da7367-9025-4df0-bacc-4eca8f5074b7 Sep 28 18:13:38 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:39 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7ba9aa92-33e5-4f91-92ca-a8418e96b668 tempest-VolumesDeleteCascade-1502592551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a1da7367-9025-4df0-bacc-4eca8f5074b7" returned: 0 in 0.759s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7ba9aa92-33e5-4f91-92ca-a8418e96b668 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a1da7367-9025-4df0-bacc-4eca8f5074b7 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:39 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a1da7367-9025-4df0-bacc-4eca8f5074b7 Sep 28 18:13:39 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:39 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7ba9aa92-33e5-4f91-92ca-a8418e96b668 tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a1da7367-9025-4df0-bacc-4eca8f5074b7" returned: 0 in 0.495s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-7ba9aa92-33e5-4f91-92ca-a8418e96b668 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-quobyte-a1da7367-9025-4df0-bacc-4eca8f5074b7" released by "delete_volume" :: held 1.326s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:39 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-7ba9aa92-33e5-4f91-92ca-a8418e96b668 tempest-VolumesDeleteCascade-1502592551 None] Created reservations ['7040ed11-49ef-49db-9292-cc2755dfbc30', 'f6d32738-6882-4444-aed4-765c3ff3148e', 'e2f7c057-4668-471f-b771-766bb291b22b', '43d63eb1-bd61-42f1-b144-c360b5b65b32'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7ba9aa92-33e5-4f91-92ca-a8418e96b668 tempest-VolumesDeleteCascade-1502592551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7ba9aa92-33e5-4f91-92ca-a8418e96b668 tempest-VolumesDeleteCascade-1502592551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-7ba9aa92-33e5-4f91-92ca-a8418e96b668 tempest-VolumesDeleteCascade-1502592551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-7ba9aa92-33e5-4f91-92ca-a8418e96b668 tempest-VolumesDeleteCascade-1502592551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7ba9aa92-33e5-4f91-92ca-a8418e96b668 tempest-VolumesDeleteCascade-1502592551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7ba9aa92-33e5-4f91-92ca-a8418e96b668 tempest-VolumesDeleteCascade-1502592551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:39 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:13:39 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:40 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7ba9aa92-33e5-4f91-92ca-a8418e96b668 tempest-VolumesDeleteCascade-1502592551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.442s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:40 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-7ba9aa92-33e5-4f91-92ca-a8418e96b668 tempest-VolumesDeleteCascade-1502592551 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:40 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-7ba9aa92-33e5-4f91-92ca-a8418e96b668 tempest-VolumesDeleteCascade-1502592551 None] Deleted volume successfully. Sep 28 18:13:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-7ba9aa92-33e5-4f91-92ca-a8418e96b668 tempest-VolumesDeleteCascade-1502592551 None] Lock "cinder-a1da7367-9025-4df0-bacc-4eca8f5074b7-delete_volume" released by "delete_volume" :: held 2.182s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:42 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:42 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Flow 'volume_create_manager' (4253b1e8-e2a4-4ea3-92c0-1607613d3fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:42 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ab2fee-9371-4d31-9f75-dbdd03fbee2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ab2fee-9371-4d31-9f75-dbdd03fbee2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1594387559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f457b7-6e28-46c1-938c-c7652851c297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82a8a844d2544da19f1ba856c86fd864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:43Z,use_quota=True,user_id='87d336b7b9b94a058a6c22672a22aed0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f8e549-22f0-4661-8255-5790455b8c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f8e549-22f0-4661-8255-5790455b8c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d571cae2-b34d-4d96-ae93-c96ee242289a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d571cae2-b34d-4d96-ae93-c96ee242289a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84f457b7-6e28-46c1-938c-c7652851c297', 'volume_name': 'volume-84f457b7-6e28-46c1-938c-c7652851c297', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31be25d-d154-487a-a9cf-1eb2f99518ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31be25d-d154-487a-a9cf-1eb2f99518ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2cb8d53-bb38-430a-9706-74bb394005c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:43 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Volume 84f457b7-6e28-46c1-938c-c7652851c297: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84f457b7-6e28-46c1-938c-c7652851c297', 'volume_size': 1} Sep 28 18:13:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1594387559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f457b7-6e28-46c1-938c-c7652851c297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82a8a844d2544da19f1ba856c86fd864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:43Z,use_quota=True,user_id='87d336b7b9b94a058a6c22672a22aed0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Creating volume 84f457b7-6e28-46c1-938c-c7652851c297 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:43 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:13:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-84f457b7-6e28-46c1-938c-c7652851c297 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:43 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-84f457b7-6e28-46c1-938c-c7652851c297 1073741824 Sep 28 18:13:43 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:43 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-84f457b7-6e28-46c1-938c-c7652851c297 1073741824" returned: 0 in 0.651s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-84f457b7-6e28-46c1-938c-c7652851c297 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:43 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-84f457b7-6e28-46c1-938c-c7652851c297 Sep 28 18:13:43 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:44 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-84f457b7-6e28-46c1-938c-c7652851c297" returned: 0 in 0.360s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:44 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2cb8d53-bb38-430a-9706-74bb394005c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84f457b7-6e28-46c1-938c-c7652851c297', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f478e9-dca8-49ff-adeb-ebd953ac05bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:44 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Volume volume-84f457b7-6e28-46c1-938c-c7652851c297 (84f457b7-6e28-46c1-938c-c7652851c297): created successfully Sep 28 18:13:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f478e9-dca8-49ff-adeb-ebd953ac05bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Flow 'volume_create_manager' (4253b1e8-e2a4-4ea3-92c0-1607613d3fdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:44 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-3f1b8491-4a0a-4856-861a-d004a0298d52 tempest-VolumesTransfersV357Test-454855680 None] Created volume successfully. Sep 28 18:13:46 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-2d193d1e-332f-47af-a6d0-478e97f9f242 tempest-VolumesTransfersV357Test-1281968656 None] Transfer volume completed successfully. Sep 28 18:13:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9a8d091f-7965-4e3d-b995-d4d1ca7411b6 tempest-VolumesTransfersV357Test-504761097 None] Acquiring lock "cinder-84f457b7-6e28-46c1-938c-c7652851c297-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9a8d091f-7965-4e3d-b995-d4d1ca7411b6 tempest-VolumesTransfersV357Test-504761097 None] Lock "cinder-84f457b7-6e28-46c1-938c-c7652851c297-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9a8d091f-7965-4e3d-b995-d4d1ca7411b6 tempest-VolumesTransfersV357Test-504761097 None] Acquiring lock "cinder-quobyte-84f457b7-6e28-46c1-938c-c7652851c297" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9a8d091f-7965-4e3d-b995-d4d1ca7411b6 tempest-VolumesTransfersV357Test-504761097 None] Lock "cinder-quobyte-84f457b7-6e28-46c1-938c-c7652851c297" acquired by "delete_volume" :: waited 0.031s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:47 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9f6991-69c8-4f9f-9024-9bbab658e2cb]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9a8d091f-7965-4e3d-b995-d4d1ca7411b6 tempest-VolumesTransfersV357Test-504761097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-84f457b7-6e28-46c1-938c-c7652851c297 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:47 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-84f457b7-6e28-46c1-938c-c7652851c297 Sep 28 18:13:47 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:48 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:48 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Flow 'volume_create_manager' (ffd57552-5858-4621-8cac-3c13b8979286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:48 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0199d9d-c4e5-4862-9a85-612bec43fda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:48 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:48 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0199d9d-c4e5-4862-9a85-612bec43fda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-328088110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051de4e5-af5a-483d-91ba-567abe9af998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da48b72f9d14497c9c7a85da9fa25425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:48Z,use_quota=True,user_id='f6d22152feb9458093cc28f74507453e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:48 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107230b2-6e9b-4965-bd52-4dcea8b1171f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:48 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107230b2-6e9b-4965-bd52-4dcea8b1171f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:48 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec751e28-5632-4550-a5a8-0fdaf0c285b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:48 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec751e28-5632-4550-a5a8-0fdaf0c285b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '051de4e5-af5a-483d-91ba-567abe9af998', 'volume_name': 'volume-051de4e5-af5a-483d-91ba-567abe9af998', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:48 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f1ab62-1e87-4f2c-afa9-009ad4307a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:48 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f1ab62-1e87-4f2c-afa9-009ad4307a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:48 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d8271f0-dfb4-4259-8b7f-22c7b48cc53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:48 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Volume 051de4e5-af5a-483d-91ba-567abe9af998: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-051de4e5-af5a-483d-91ba-567abe9af998', 'volume_size': 1} Sep 28 18:13:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:48 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-328088110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051de4e5-af5a-483d-91ba-567abe9af998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da48b72f9d14497c9c7a85da9fa25425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:48Z,use_quota=True,user_id='f6d22152feb9458093cc28f74507453e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:48 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Creating volume 051de4e5-af5a-483d-91ba-567abe9af998 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:48 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:48 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:48 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:48 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:13:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-051de4e5-af5a-483d-91ba-567abe9af998 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9a8d091f-7965-4e3d-b995-d4d1ca7411b6 tempest-VolumesTransfersV357Test-504761097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-84f457b7-6e28-46c1-938c-c7652851c297" returned: 0 in 0.774s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9a8d091f-7965-4e3d-b995-d4d1ca7411b6 tempest-VolumesTransfersV357Test-504761097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-84f457b7-6e28-46c1-938c-c7652851c297 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:48 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-051de4e5-af5a-483d-91ba-567abe9af998 1073741824 Sep 28 18:13:48 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:48 devstack sudo[98048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-84f457b7-6e28-46c1-938c-c7652851c297 Sep 28 18:13:48 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:48 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9a8d091f-7965-4e3d-b995-d4d1ca7411b6 tempest-VolumesTransfersV357Test-504761097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-84f457b7-6e28-46c1-938c-c7652851c297" returned: 0 in 0.376s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:48 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9a8d091f-7965-4e3d-b995-d4d1ca7411b6 tempest-VolumesTransfersV357Test-504761097 None] Lock "cinder-quobyte-84f457b7-6e28-46c1-938c-c7652851c297" released by "delete_volume" :: held 1.222s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:48 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-9a8d091f-7965-4e3d-b995-d4d1ca7411b6 tempest-VolumesTransfersV357Test-504761097 None] Created reservations ['558270e7-be2d-4c27-a932-48e17a7dee4e', '305bc343-77a9-46ef-b1bb-c4ec7c4b5154', '0a2269aa-2dfa-4949-ab7b-4538bb27f3f8', 'e18b91fd-c1c4-4b62-9e37-c493fa487dfa'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:49 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-051de4e5-af5a-483d-91ba-567abe9af998 1073741824" returned: 0 in 0.629s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-9a8d091f-7965-4e3d-b995-d4d1ca7411b6 tempest-VolumesTransfersV357Test-504761097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-9a8d091f-7965-4e3d-b995-d4d1ca7411b6 tempest-VolumesTransfersV357Test-504761097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-9a8d091f-7965-4e3d-b995-d4d1ca7411b6 tempest-VolumesTransfersV357Test-504761097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-9a8d091f-7965-4e3d-b995-d4d1ca7411b6 tempest-VolumesTransfersV357Test-504761097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-9a8d091f-7965-4e3d-b995-d4d1ca7411b6 tempest-VolumesTransfersV357Test-504761097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9a8d091f-7965-4e3d-b995-d4d1ca7411b6 tempest-VolumesTransfersV357Test-504761097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:49 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:13:49 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-051de4e5-af5a-483d-91ba-567abe9af998 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:49 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-051de4e5-af5a-483d-91ba-567abe9af998 Sep 28 18:13:49 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:49 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9a8d091f-7965-4e3d-b995-d4d1ca7411b6 tempest-VolumesTransfersV357Test-504761097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.362s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:49 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-9a8d091f-7965-4e3d-b995-d4d1ca7411b6 tempest-VolumesTransfersV357Test-504761097 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:49 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-9a8d091f-7965-4e3d-b995-d4d1ca7411b6 tempest-VolumesTransfersV357Test-504761097 None] Deleted volume successfully. Sep 28 18:13:49 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9a8d091f-7965-4e3d-b995-d4d1ca7411b6 tempest-VolumesTransfersV357Test-504761097 None] Lock "cinder-84f457b7-6e28-46c1-938c-c7652851c297-delete_volume" released by "delete_volume" :: held 1.969s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:49 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-051de4e5-af5a-483d-91ba-567abe9af998" returned: 0 in 0.395s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d8271f0-dfb4-4259-8b7f-22c7b48cc53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-051de4e5-af5a-483d-91ba-567abe9af998', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3680d3b-70da-4c35-8745-c22c6a62e429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:49 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Volume volume-051de4e5-af5a-483d-91ba-567abe9af998 (051de4e5-af5a-483d-91ba-567abe9af998): created successfully Sep 28 18:13:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3680d3b-70da-4c35-8745-c22c6a62e429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Flow 'volume_create_manager' (ffd57552-5858-4621-8cac-3c13b8979286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:49 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-9615a412-c7bc-4b0c-ab58-91c50ae75d7a tempest-VolumesMetadataTest-1559780694 None] Created volume successfully. Sep 28 18:13:50 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:13:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Flow 'volume_create_manager' (da2b4b04-c2b7-446d-b0e4-e2829af4c012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5efb8474-1231-4eb4-937a-0c109c938028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5efb8474-1231-4eb4-937a-0c109c938028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-399927708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bdf4362-48be-419b-afd2-355bb99f6e82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82a8a844d2544da19f1ba856c86fd864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:51Z,use_quota=True,user_id='87d336b7b9b94a058a6c22672a22aed0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247eb7ea-3367-4dd9-a79e-4bbcafac6396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247eb7ea-3367-4dd9-a79e-4bbcafac6396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99cc9a99-d100-4337-bef6-90fe55d7a0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99cc9a99-d100-4337-bef6-90fe55d7a0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bdf4362-48be-419b-afd2-355bb99f6e82', 'volume_name': 'volume-6bdf4362-48be-419b-afd2-355bb99f6e82', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca473a83-95bc-4c1e-b343-41ed18caeaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca473a83-95bc-4c1e-b343-41ed18caeaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60d56426-6947-4bda-8000-6cf9e5c59e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:50 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Volume 6bdf4362-48be-419b-afd2-355bb99f6e82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bdf4362-48be-419b-afd2-355bb99f6e82', 'volume_size': 1} Sep 28 18:13:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-399927708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bdf4362-48be-419b-afd2-355bb99f6e82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82a8a844d2544da19f1ba856c86fd864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:13:51Z,use_quota=True,user_id='87d336b7b9b94a058a6c22672a22aed0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:13:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Creating volume 6bdf4362-48be-419b-afd2-355bb99f6e82 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:13:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:13:50 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:13:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6bdf4362-48be-419b-afd2-355bb99f6e82 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:50 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6bdf4362-48be-419b-afd2-355bb99f6e82 1073741824 Sep 28 18:13:50 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:51 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6bdf4362-48be-419b-afd2-355bb99f6e82 1073741824" returned: 0 in 0.837s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6bdf4362-48be-419b-afd2-355bb99f6e82 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:51 devstack sudo[98071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6bdf4362-48be-419b-afd2-355bb99f6e82 Sep 28 18:13:51 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:51 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ab02b69a-04ff-4cf0-b019-8b77555b8fb4 tempest-VolumesMetadataTest-1559780694 None] Acquiring lock "cinder-051de4e5-af5a-483d-91ba-567abe9af998-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:51 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ab02b69a-04ff-4cf0-b019-8b77555b8fb4 tempest-VolumesMetadataTest-1559780694 None] Lock "cinder-051de4e5-af5a-483d-91ba-567abe9af998-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:51 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ab02b69a-04ff-4cf0-b019-8b77555b8fb4 tempest-VolumesMetadataTest-1559780694 None] Acquiring lock "cinder-quobyte-051de4e5-af5a-483d-91ba-567abe9af998" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:51 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ab02b69a-04ff-4cf0-b019-8b77555b8fb4 tempest-VolumesMetadataTest-1559780694 None] Lock "cinder-quobyte-051de4e5-af5a-483d-91ba-567abe9af998" acquired by "delete_volume" :: waited 0.031s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:51 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ab3378-3825-4c52-8d3a-9a43e45d962a]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ab02b69a-04ff-4cf0-b019-8b77555b8fb4 tempest-VolumesMetadataTest-1559780694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-051de4e5-af5a-483d-91ba-567abe9af998 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:52 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6bdf4362-48be-419b-afd2-355bb99f6e82" returned: 0 in 0.467s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:52 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:13:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60d56426-6947-4bda-8000-6cf9e5c59e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bdf4362-48be-419b-afd2-355bb99f6e82', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba069aef-3ead-4490-aade-83cad15bd4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:13:52 devstack sudo[98073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-051de4e5-af5a-483d-91ba-567abe9af998 Sep 28 18:13:52 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:52 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Volume volume-6bdf4362-48be-419b-afd2-355bb99f6e82 (6bdf4362-48be-419b-afd2-355bb99f6e82): created successfully Sep 28 18:13:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba069aef-3ead-4490-aade-83cad15bd4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:13:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Flow 'volume_create_manager' (da2b4b04-c2b7-446d-b0e4-e2829af4c012) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:13:52 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-e00869fd-c5fd-46f7-b808-39aa80df1d46 tempest-VolumesTransfersV357Test-454855680 None] Created volume successfully. Sep 28 18:13:52 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ab02b69a-04ff-4cf0-b019-8b77555b8fb4 tempest-VolumesMetadataTest-1559780694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-051de4e5-af5a-483d-91ba-567abe9af998" returned: 0 in 0.756s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ab02b69a-04ff-4cf0-b019-8b77555b8fb4 tempest-VolumesMetadataTest-1559780694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-051de4e5-af5a-483d-91ba-567abe9af998 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:52 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-051de4e5-af5a-483d-91ba-567abe9af998 Sep 28 18:13:52 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:53 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ab02b69a-04ff-4cf0-b019-8b77555b8fb4 tempest-VolumesMetadataTest-1559780694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-051de4e5-af5a-483d-91ba-567abe9af998" returned: 0 in 0.501s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:53 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ab02b69a-04ff-4cf0-b019-8b77555b8fb4 tempest-VolumesMetadataTest-1559780694 None] Lock "cinder-quobyte-051de4e5-af5a-483d-91ba-567abe9af998" released by "delete_volume" :: held 1.334s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:53 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-ab02b69a-04ff-4cf0-b019-8b77555b8fb4 tempest-VolumesMetadataTest-1559780694 None] Created reservations ['e611e48f-be1a-4441-8341-6d5cc5334335', '68f7674d-a64e-4611-8f18-0944fb439543', '15d6ece6-167e-46b3-acc0-4b4578f06acb', '75ebab7d-56cb-46ff-8d7e-6dede815ba6e'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ab02b69a-04ff-4cf0-b019-8b77555b8fb4 tempest-VolumesMetadataTest-1559780694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ab02b69a-04ff-4cf0-b019-8b77555b8fb4 tempest-VolumesMetadataTest-1559780694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ab02b69a-04ff-4cf0-b019-8b77555b8fb4 tempest-VolumesMetadataTest-1559780694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ab02b69a-04ff-4cf0-b019-8b77555b8fb4 tempest-VolumesMetadataTest-1559780694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ab02b69a-04ff-4cf0-b019-8b77555b8fb4 tempest-VolumesMetadataTest-1559780694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ab02b69a-04ff-4cf0-b019-8b77555b8fb4 tempest-VolumesMetadataTest-1559780694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:53 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ed059f02-8561-4982-83aa-0a710b88451b tempest-VolumesTransfersV357Test-504761097 None] Acquiring lock "cinder-6bdf4362-48be-419b-afd2-355bb99f6e82-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:53 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:13:53 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:53 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ed059f02-8561-4982-83aa-0a710b88451b tempest-VolumesTransfersV357Test-504761097 None] Lock "cinder-6bdf4362-48be-419b-afd2-355bb99f6e82-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:53 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ed059f02-8561-4982-83aa-0a710b88451b tempest-VolumesTransfersV357Test-504761097 None] Acquiring lock "cinder-quobyte-6bdf4362-48be-419b-afd2-355bb99f6e82" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:13:53 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ed059f02-8561-4982-83aa-0a710b88451b tempest-VolumesTransfersV357Test-504761097 None] Lock "cinder-quobyte-6bdf4362-48be-419b-afd2-355bb99f6e82" acquired by "delete_volume" :: waited 0.027s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:13:53 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1140edb-4a88-4273-9048-b8528bb24f7e]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:13:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ed059f02-8561-4982-83aa-0a710b88451b tempest-VolumesTransfersV357Test-504761097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6bdf4362-48be-419b-afd2-355bb99f6e82 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:53 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ab02b69a-04ff-4cf0-b019-8b77555b8fb4 tempest-VolumesMetadataTest-1559780694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.454s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:53 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-ab02b69a-04ff-4cf0-b019-8b77555b8fb4 tempest-VolumesMetadataTest-1559780694 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:54 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-ab02b69a-04ff-4cf0-b019-8b77555b8fb4 tempest-VolumesMetadataTest-1559780694 None] Deleted volume successfully. Sep 28 18:13:54 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6bdf4362-48be-419b-afd2-355bb99f6e82 Sep 28 18:13:54 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:54 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ab02b69a-04ff-4cf0-b019-8b77555b8fb4 tempest-VolumesMetadataTest-1559780694 None] Lock "cinder-051de4e5-af5a-483d-91ba-567abe9af998-delete_volume" released by "delete_volume" :: held 2.252s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:54 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ed059f02-8561-4982-83aa-0a710b88451b tempest-VolumesTransfersV357Test-504761097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6bdf4362-48be-419b-afd2-355bb99f6e82" returned: 0 in 0.594s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ed059f02-8561-4982-83aa-0a710b88451b tempest-VolumesTransfersV357Test-504761097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6bdf4362-48be-419b-afd2-355bb99f6e82 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:54 devstack sudo[98154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6bdf4362-48be-419b-afd2-355bb99f6e82 Sep 28 18:13:54 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:54 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ed059f02-8561-4982-83aa-0a710b88451b tempest-VolumesTransfersV357Test-504761097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6bdf4362-48be-419b-afd2-355bb99f6e82" returned: 0 in 0.336s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:54 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ed059f02-8561-4982-83aa-0a710b88451b tempest-VolumesTransfersV357Test-504761097 None] Lock "cinder-quobyte-6bdf4362-48be-419b-afd2-355bb99f6e82" released by "delete_volume" :: held 1.025s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:13:54 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-ed059f02-8561-4982-83aa-0a710b88451b tempest-VolumesTransfersV357Test-504761097 None] Created reservations ['b85d9a6a-12d7-40f3-b3ed-87171ab7fc04', '81d48c30-be4f-4291-9642-184813974026', '961c39de-7b23-4513-aae3-030d0f0b6f0d', 'd6b6dc9b-7da1-414e-9786-cf022a86ea32'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:13:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ed059f02-8561-4982-83aa-0a710b88451b tempest-VolumesTransfersV357Test-504761097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:13:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ed059f02-8561-4982-83aa-0a710b88451b tempest-VolumesTransfersV357Test-504761097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:13:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ed059f02-8561-4982-83aa-0a710b88451b tempest-VolumesTransfersV357Test-504761097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:13:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ed059f02-8561-4982-83aa-0a710b88451b tempest-VolumesTransfersV357Test-504761097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:13:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ed059f02-8561-4982-83aa-0a710b88451b tempest-VolumesTransfersV357Test-504761097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:13:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ed059f02-8561-4982-83aa-0a710b88451b tempest-VolumesTransfersV357Test-504761097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:13:55 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:13:55 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:13:55 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Sep 28 18:13:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ed059f02-8561-4982-83aa-0a710b88451b tempest-VolumesTransfersV357Test-504761097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.321s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:13:55 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-ed059f02-8561-4982-83aa-0a710b88451b tempest-VolumesTransfersV357Test-504761097 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:13:55 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-ed059f02-8561-4982-83aa-0a710b88451b tempest-VolumesTransfersV357Test-504761097 None] Deleted volume successfully. Sep 28 18:13:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ed059f02-8561-4982-83aa-0a710b88451b tempest-VolumesTransfersV357Test-504761097 None] Lock "cinder-6bdf4362-48be-419b-afd2-355bb99f6e82-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:03 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-b2229b45-96e3-4403-8b36-091a713e2bcc req-fd94f241-59c7-47bd-8ca7-c988f2bafc7b tempest-AttachVolumeNegativeTest-1060566598 None] Terminate volume connection completed successfully. Sep 28 18:14:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-b2229b45-96e3-4403-8b36-091a713e2bcc req-fd94f241-59c7-47bd-8ca7-c988f2bafc7b tempest-AttachVolumeNegativeTest-1060566598 None] Deleting attachment ffabb14b-39cb-4c04-9208-9753394b8f25. {{(pid=86980) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:14:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:14:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:04 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:14:04 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:05 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.634s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:05 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:05 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager._thread_info {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:14:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread count: 28 {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:14:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread info: [<_MainThread(MainThread, started 129097393381504)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:14:07 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Flow 'volume_create_manager' (18e0e7d1-67ed-42bf-8016-2a77598abe8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a744e3-a9b6-4b4e-a3d8-e906905e0bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a744e3-a9b6-4b4e-a3d8-e906905e0bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1310054590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30fec9c-c578-4cbf-a289-b97bd650c139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88993609c5f043e3bf11bd9c33a8f0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:07Z,use_quota=True,user_id='98711139681b4130b6ab7f4fc972bb6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a63118f7-93a8-4922-8889-16f71d1f31aa),volume_type_id=a63118f7-93a8-4922-8889-16f71d1f31aa)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59126d7f-a4c9-422c-bd04-a2ccad49b7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59126d7f-a4c9-422c-bd04-a2ccad49b7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d154b5a-855b-4495-bbcd-d44bdce6dfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d154b5a-855b-4495-bbcd-d44bdce6dfcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a30fec9c-c578-4cbf-a289-b97bd650c139', 'volume_name': 'volume-a30fec9c-c578-4cbf-a289-b97bd650c139', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71094a5b-24c7-4c58-af40-16cd0be94d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71094a5b-24c7-4c58-af40-16cd0be94d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bddf0adb-3c7d-4e9c-9a94-1fcbcfa9f844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:07 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Volume a30fec9c-c578-4cbf-a289-b97bd650c139: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a30fec9c-c578-4cbf-a289-b97bd650c139', 'volume_size': 1} Sep 28 18:14:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1310054590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30fec9c-c578-4cbf-a289-b97bd650c139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88993609c5f043e3bf11bd9c33a8f0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:07Z,use_quota=True,user_id='98711139681b4130b6ab7f4fc972bb6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a63118f7-93a8-4922-8889-16f71d1f31aa),volume_type_id=a63118f7-93a8-4922-8889-16f71d1f31aa)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Creating volume a30fec9c-c578-4cbf-a289-b97bd650c139 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:07 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:14:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a30fec9c-c578-4cbf-a289-b97bd650c139 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:07 devstack sudo[98204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a30fec9c-c578-4cbf-a289-b97bd650c139 1073741824 Sep 28 18:14:07 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:08 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a30fec9c-c578-4cbf-a289-b97bd650c139 1073741824" returned: 0 in 0.959s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Flow 'volume_create_manager' (4a14bd50-56e1-49ec-8d9a-5d1b8128b728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b90608b-d0a9-4688-b76b-6965932d1d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b90608b-d0a9-4688-b76b-6965932d1d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1847025440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6776b57-536f-4121-9477-656e635367c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88993609c5f043e3bf11bd9c33a8f0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:08Z,use_quota=True,user_id='98711139681b4130b6ab7f4fc972bb6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3606a27d-671a-436c-b3ce-fc40de4f94a6),volume_type_id=3606a27d-671a-436c-b3ce-fc40de4f94a6)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a81cbf4-4439-4150-aa3c-d907966626b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a81cbf4-4439-4150-aa3c-d907966626b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20880051-abaa-48ca-93fe-d04d8c022ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20880051-abaa-48ca-93fe-d04d8c022ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6776b57-536f-4121-9477-656e635367c8', 'volume_name': 'volume-f6776b57-536f-4121-9477-656e635367c8', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19151035-034b-4ad9-8ccd-8a736cd752c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19151035-034b-4ad9-8ccd-8a736cd752c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae3e68e-7944-40f1-a1b6-665fcce02a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:08 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Volume f6776b57-536f-4121-9477-656e635367c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6776b57-536f-4121-9477-656e635367c8', 'volume_size': 1} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a30fec9c-c578-4cbf-a289-b97bd650c139 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:08 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a30fec9c-c578-4cbf-a289-b97bd650c139 Sep 28 18:14:08 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Flow 'volume_create_manager' (71fdb085-8881-49ca-bef4-6204ac3b0e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ad4d39-47b1-4c6a-bf4a-6ee406542fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ad4d39-47b1-4c6a-bf4a-6ee406542fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-277790066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a06d6bb-cd80-4e49-a796-2b52828f7371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0472e44d4ac4f8eb12c8d41977fb14a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:08Z,use_quota=True,user_id='18fb23ccf65d46d9ba7220403e135f13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e38a11d-1ba8-4474-a919-440a1e40f556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e38a11d-1ba8-4474-a919-440a1e40f556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3082e122-8c16-4580-bf17-c91041e39d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3082e122-8c16-4580-bf17-c91041e39d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a06d6bb-cd80-4e49-a796-2b52828f7371', 'volume_name': 'volume-1a06d6bb-cd80-4e49-a796-2b52828f7371', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44da8976-3cc0-475b-886e-46235a6c51d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44da8976-3cc0-475b-886e-46235a6c51d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52513041-7c7f-4b35-b761-eb46b1519659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:08 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Volume 1a06d6bb-cd80-4e49-a796-2b52828f7371: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a06d6bb-cd80-4e49-a796-2b52828f7371', 'volume_size': 1} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:08 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a30fec9c-c578-4cbf-a289-b97bd650c139" returned: 0 in 0.528s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.553s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1847025440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6776b57-536f-4121-9477-656e635367c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88993609c5f043e3bf11bd9c33a8f0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:08Z,use_quota=True,user_id='98711139681b4130b6ab7f4fc972bb6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3606a27d-671a-436c-b3ce-fc40de4f94a6),volume_type_id=3606a27d-671a-436c-b3ce-fc40de4f94a6)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Creating volume f6776b57-536f-4121-9477-656e635367c8 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:08 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f6776b57-536f-4121-9477-656e635367c8 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:08 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f6776b57-536f-4121-9477-656e635367c8 1073741824 Sep 28 18:14:08 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bddf0adb-3c7d-4e9c-9a94-1fcbcfa9f844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a30fec9c-c578-4cbf-a289-b97bd650c139', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cea7805c-0369-407a-948e-8c1f32903fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:09 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Volume volume-a30fec9c-c578-4cbf-a289-b97bd650c139 (a30fec9c-c578-4cbf-a289-b97bd650c139): created successfully Sep 28 18:14:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cea7805c-0369-407a-948e-8c1f32903fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Flow 'volume_create_manager' (18e0e7d1-67ed-42bf-8016-2a77598abe8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:09 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-e07ef0c8-06e2-4e07-9feb-7d88cab39e8b tempest-TestInstancesWithCinderVolumes-359587429 None] Created volume successfully. Sep 28 18:14:09 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Flow 'volume_create_manager' (bc01fded-e59d-4883-9c00-d1d5346932f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef587b3b-b9db-4643-832b-e92957dc2f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef587b3b-b9db-4643-832b-e92957dc2f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-935427128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a91805d-b326-416a-9d78-88abd23b9cfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88993609c5f043e3bf11bd9c33a8f0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:09Z,use_quota=True,user_id='98711139681b4130b6ab7f4fc972bb6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08688770-9dda-4df5-905e-e197c3e22064),volume_type_id=08688770-9dda-4df5-905e-e197c3e22064)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec03813-d1cb-4294-bfdf-e129a76d0266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec03813-d1cb-4294-bfdf-e129a76d0266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20639338-e64e-4a14-b8e5-aa6cfc92a471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:09 devstack cinder-volume[86980]: DEBUG cinder.image.glance [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Creating Keystone auth plugin from conf {{(pid=86980) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:14:09 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f6776b57-536f-4121-9477-656e635367c8 1073741824" returned: 0 in 0.886s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f6776b57-536f-4121-9477-656e635367c8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:09 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f6776b57-536f-4121-9477-656e635367c8 Sep 28 18:14:09 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:10 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20639338-e64e-4a14-b8e5-aa6cfc92a471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2a91805d-b326-416a-9d78-88abd23b9cfb', 'volume_name': 'volume-2a91805d-b326-416a-9d78-88abd23b9cfb', 'volume_size': 1, 'image_id': '42d5558a-bcde-48e4-9b4b-5abad9bb9c78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/42d5558a-bcde-48e4-9b4b-5abad9bb9c78', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1742255051', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88993609c5f043e3bf11bd9c33a8f0f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '42d5558a-bcde-48e4-9b4b-5abad9bb9c78', 'created_at': datetime.datetime(2026, 9, 28, 16, 14, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 14, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/42d5558a-bcde-48e4-9b4b-5abad9bb9c78/file', 'properties': {}}, 'image_service': }' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:10 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bbecb29-2461-4982-8b30-3fd1e2b71998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:10 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bbecb29-2461-4982-8b30-3fd1e2b71998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:10 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d954c56-f8b2-4760-a8d9-dae5cc112a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:10 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Volume 2a91805d-b326-416a-9d78-88abd23b9cfb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2a91805d-b326-416a-9d78-88abd23b9cfb', 'volume_size': 1, 'image_id': '42d5558a-bcde-48e4-9b4b-5abad9bb9c78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/42d5558a-bcde-48e4-9b4b-5abad9bb9c78', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1742255051', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88993609c5f043e3bf11bd9c33a8f0f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '42d5558a-bcde-48e4-9b4b-5abad9bb9c78', 'created_at': datetime.datetime(2026, 9, 28, 16, 14, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 14, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/42d5558a-bcde-48e4-9b4b-5abad9bb9c78/file', 'properties': {}}, 'image_service': } Sep 28 18:14:10 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Trying to clone 2a91805d-b326-416a-9d78-88abd23b9cfb from image 42d5558a-bcde-48e4-9b4b-5abad9bb9c78 at location (None, [{'url': 'file:///opt/stack/data/glance/images/42d5558a-bcde-48e4-9b4b-5abad9bb9c78', 'metadata': {}}]). {{(pid=86980) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:14:10 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f6776b57-536f-4121-9477-656e635367c8" returned: 0 in 0.516s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:10 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.685s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:10 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-277790066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a06d6bb-cd80-4e49-a796-2b52828f7371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0472e44d4ac4f8eb12c8d41977fb14a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:08Z,use_quota=True,user_id='18fb23ccf65d46d9ba7220403e135f13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:10 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Creating volume 1a06d6bb-cd80-4e49-a796-2b52828f7371 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:10 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:10 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:10 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:10 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:14:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1a06d6bb-cd80-4e49-a796-2b52828f7371 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:10 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1a06d6bb-cd80-4e49-a796-2b52828f7371 1073741824 Sep 28 18:14:10 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:10 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae3e68e-7944-40f1-a1b6-665fcce02a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6776b57-536f-4121-9477-656e635367c8', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:10 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619b5075-707f-4952-b6e3-f0264b560bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:10 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Volume volume-f6776b57-536f-4121-9477-656e635367c8 (f6776b57-536f-4121-9477-656e635367c8): created successfully Sep 28 18:14:10 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619b5075-707f-4952-b6e3-f0264b560bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:10 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Flow 'volume_create_manager' (4a14bd50-56e1-49ec-8d9a-5d1b8128b728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:10 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-c920518c-2b1a-4bef-9645-c14930f5a668 tempest-TestInstancesWithCinderVolumes-359587429 None] Created volume successfully. Sep 28 18:14:11 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1a06d6bb-cd80-4e49-a796-2b52828f7371 1073741824" returned: 0 in 0.740s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1a06d6bb-cd80-4e49-a796-2b52828f7371 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:11 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1a06d6bb-cd80-4e49-a796-2b52828f7371 Sep 28 18:14:11 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:11 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1a06d6bb-cd80-4e49-a796-2b52828f7371" returned: 0 in 0.506s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:11 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:11 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52513041-7c7f-4b35-b761-eb46b1519659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a06d6bb-cd80-4e49-a796-2b52828f7371', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:11 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d251683-9167-4611-8107-97d0c93b19ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:11 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Volume volume-1a06d6bb-cd80-4e49-a796-2b52828f7371 (1a06d6bb-cd80-4e49-a796-2b52828f7371): created successfully Sep 28 18:14:11 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d251683-9167-4611-8107-97d0c93b19ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:11 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Flow 'volume_create_manager' (71fdb085-8881-49ca-bef4-6204ac3b0e12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:11 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-3521a6dc-6982-41f4-b5d7-da66d9f91e14 tempest-VolumesTransfersV355Test-1799920160 None] Created volume successfully. Sep 28 18:14:12 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:12 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Flow 'volume_create_manager' (d5ae6523-b272-43d2-b81d-57f11439f7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:12 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d4cca13-4f89-44e9-84f1-da3e7aadda6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:12 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d4cca13-4f89-44e9-84f1-da3e7aadda6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1962369603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1562e69fbd4b68908475eccdb6899b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:13Z,use_quota=True,user_id='bc8102cd9f324135a336ee1452dbebd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:12 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c04cbbf5-28f7-4b3f-b54d-e46785da2d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:12 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c04cbbf5-28f7-4b3f-b54d-e46785da2d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:12 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66354a19-834f-4856-9872-2e911be49dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:12 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66354a19-834f-4856-9872-2e911be49dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a', 'volume_name': 'volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a', 'volume_size': 2}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:12 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b460d313-ef74-4684-87ba-a327e011d745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:12 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b460d313-ef74-4684-87ba-a327e011d745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:12 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67f5ff7-56ec-49e3-83e3-b22b6fc3a033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:12 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Volume b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a', 'volume_size': 2} Sep 28 18:14:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:12 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1962369603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1562e69fbd4b68908475eccdb6899b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:13Z,use_quota=True,user_id='bc8102cd9f324135a336ee1452dbebd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:12 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Creating volume b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:12 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:12 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:12 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:12 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:14:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a 2147483648 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:12 devstack sudo[98234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a 2147483648 Sep 28 18:14:12 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:13 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a 2147483648" returned: 0 in 0.836s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:13 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a Sep 28 18:14:13 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:14 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-2a5d8e2f-0627-428b-90e4-0fb394537b6a tempest-VolumesTransfersV355Test-1791524117 None] Transfer volume completed successfully. Sep 28 18:14:14 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a" returned: 0 in 0.397s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:14 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67f5ff7-56ec-49e3-83e3-b22b6fc3a033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a', 'volume_size': 2}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (399091f9-733c-418e-8d2f-8c56b45d27da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:14 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Volume volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a (b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a): created successfully Sep 28 18:14:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (399091f9-733c-418e-8d2f-8c56b45d27da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Flow 'volume_create_manager' (d5ae6523-b272-43d2-b81d-57f11439f7d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:14 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-47a2426c-2d8e-4dbc-a427-d5a027d12472 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Created volume successfully. Sep 28 18:14:14 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1ae68eb9-72e9-4afc-b722-492ee64f6573 tempest-VolumesTransfersV355Test-580149687 None] Acquiring lock "cinder-1a06d6bb-cd80-4e49-a796-2b52828f7371-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:14 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1ae68eb9-72e9-4afc-b722-492ee64f6573 tempest-VolumesTransfersV355Test-580149687 None] Lock "cinder-1a06d6bb-cd80-4e49-a796-2b52828f7371-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:15 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1ae68eb9-72e9-4afc-b722-492ee64f6573 tempest-VolumesTransfersV355Test-580149687 None] Acquiring lock "cinder-quobyte-1a06d6bb-cd80-4e49-a796-2b52828f7371" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:15 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1ae68eb9-72e9-4afc-b722-492ee64f6573 tempest-VolumesTransfersV355Test-580149687 None] Lock "cinder-quobyte-1a06d6bb-cd80-4e49-a796-2b52828f7371" acquired by "delete_volume" :: waited 0.028s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-fb38ecec-65d1-4fae-b80e-61567ece0439 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-fb38ecec-65d1-4fae-b80e-61567ece0439 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:15 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2841ed64-ab53-4a78-a83f-7be51adfe2e0]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1ae68eb9-72e9-4afc-b722-492ee64f6573 tempest-VolumesTransfersV355Test-580149687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1a06d6bb-cd80-4e49-a796-2b52828f7371 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:15 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-fb38ecec-65d1-4fae-b80e-61567ece0439 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Creating offline snapshot 3a3ec7d1-86a3-4f24-a442-e5ed61c08e7e of volume b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:14:15 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[52eb6523-12ed-4150-9767-e6462367d274]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fb38ecec-65d1-4fae-b80e-61567ece0439 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:15 devstack sudo[98243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1a06d6bb-cd80-4e49-a796-2b52828f7371 Sep 28 18:14:15 devstack sudo[98243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:15 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a Sep 28 18:14:15 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:15 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fb38ecec-65d1-4fae-b80e-61567ece0439 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a" returned: 0 in 0.576s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fb38ecec-65d1-4fae-b80e-61567ece0439 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a.3a3ec7d1-86a3-4f24-a442-e5ed61c08e7e 2G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:15 devstack sudo[98243]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1ae68eb9-72e9-4afc-b722-492ee64f6573 tempest-VolumesTransfersV355Test-580149687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1a06d6bb-cd80-4e49-a796-2b52828f7371" returned: 0 in 0.651s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1ae68eb9-72e9-4afc-b722-492ee64f6573 tempest-VolumesTransfersV355Test-580149687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1a06d6bb-cd80-4e49-a796-2b52828f7371 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:15 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a.3a3ec7d1-86a3-4f24-a442-e5ed61c08e7e 2G Sep 28 18:14:15 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:15 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1a06d6bb-cd80-4e49-a796-2b52828f7371 Sep 28 18:14:15 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:15 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_42d5558a-bcde-48e4-9b4b-5abad9bb9c78_x3cpo682devstack@QuobyteHD, size 20.69 MB, duration 5.68 sec {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:14:15 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Image download 20.69 MB at 3.64 MB/s Sep 28 18:14:15 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae504b9-d71a-499e-b433-36b9527759bf]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_42d5558a-bcde-48e4-9b4b-5abad9bb9c78_x3cpo682devstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:16 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_42d5558a-bcde-48e4-9b4b-5abad9bb9c78_x3cpo682devstack@QuobyteHD Sep 28 18:14:16 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:16 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1ae68eb9-72e9-4afc-b722-492ee64f6573 tempest-VolumesTransfersV355Test-580149687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1a06d6bb-cd80-4e49-a796-2b52828f7371" returned: 0 in 0.387s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:16 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1ae68eb9-72e9-4afc-b722-492ee64f6573 tempest-VolumesTransfersV355Test-580149687 None] Lock "cinder-quobyte-1a06d6bb-cd80-4e49-a796-2b52828f7371" released by "delete_volume" :: held 1.146s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:16 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-1ae68eb9-72e9-4afc-b722-492ee64f6573 tempest-VolumesTransfersV355Test-580149687 None] Created reservations ['254c3a64-633c-47a9-815d-67fbd3142edf', '83b4a3b5-1c63-4a9c-8b1b-4f6c0e6e2a89', '1a1be63f-8d89-450c-9bd9-cbc3b61dc657', '74735260-ed8b-4b09-97ef-0b1c570dd190'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:16 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1ae68eb9-72e9-4afc-b722-492ee64f6573 tempest-VolumesTransfersV355Test-580149687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1ae68eb9-72e9-4afc-b722-492ee64f6573 tempest-VolumesTransfersV355Test-580149687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1ae68eb9-72e9-4afc-b722-492ee64f6573 tempest-VolumesTransfersV355Test-580149687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1ae68eb9-72e9-4afc-b722-492ee64f6573 tempest-VolumesTransfersV355Test-580149687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1ae68eb9-72e9-4afc-b722-492ee64f6573 tempest-VolumesTransfersV355Test-580149687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1ae68eb9-72e9-4afc-b722-492ee64f6573 tempest-VolumesTransfersV355Test-580149687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:16 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fb38ecec-65d1-4fae-b80e-61567ece0439 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a.3a3ec7d1-86a3-4f24-a442-e5ed61c08e7e 2G" returned: 0 in 0.676s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fb38ecec-65d1-4fae-b80e-61567ece0439 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a.3a3ec7d1-86a3-4f24-a442-e5ed61c08e7e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_42d5558a-bcde-48e4-9b4b-5abad9bb9c78_x3cpo682devstack@QuobyteHD" returned: 0 in 0.527s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:16 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Temporary image 42d5558a-bcde-48e4-9b4b-5abad9bb9c78 is fetched for user 98711139681b4130b6ab7f4fc972bb6b. {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:14:16 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:14:16 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:16 devstack sudo[98268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a.3a3ec7d1-86a3-4f24-a442-e5ed61c08e7e Sep 28 18:14:16 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:16 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47a355e-9968-40c7-9d9f-2597b5add369]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_42d5558a-bcde-48e4-9b4b-5abad9bb9c78_x3cpo682devstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:16 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_42d5558a-bcde-48e4-9b4b-5abad9bb9c78_x3cpo682devstack@QuobyteHD Sep 28 18:14:16 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:16 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1ae68eb9-72e9-4afc-b722-492ee64f6573 tempest-VolumesTransfersV355Test-580149687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.431s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:16 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-1ae68eb9-72e9-4afc-b722-492ee64f6573 tempest-VolumesTransfersV355Test-580149687 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:16 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-1ae68eb9-72e9-4afc-b722-492ee64f6573 tempest-VolumesTransfersV355Test-580149687 None] Deleted volume successfully. Sep 28 18:14:16 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1ae68eb9-72e9-4afc-b722-492ee64f6573 tempest-VolumesTransfersV355Test-580149687 None] Lock "cinder-1a06d6bb-cd80-4e49-a796-2b52828f7371-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:16 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fb38ecec-65d1-4fae-b80e-61567ece0439 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a.3a3ec7d1-86a3-4f24-a442-e5ed61c08e7e" returned: 0 in 0.498s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:16 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-fb38ecec-65d1-4fae-b80e-61567ece0439 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a.3a3ec7d1-86a3-4f24-a442-e5ed61c08e7e is being set with open permissions: ugo+rw Sep 28 18:14:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fb38ecec-65d1-4fae-b80e-61567ece0439 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a.3a3ec7d1-86a3-4f24-a442-e5ed61c08e7e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:16 devstack sudo[98277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a.3a3ec7d1-86a3-4f24-a442-e5ed61c08e7e Sep 28 18:14:16 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:17 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_42d5558a-bcde-48e4-9b4b-5abad9bb9c78_x3cpo682devstack@QuobyteHD" returned: 0 in 0.497s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:17 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fb38ecec-65d1-4fae-b80e-61567ece0439 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a.3a3ec7d1-86a3-4f24-a442-e5ed61c08e7e" returned: 0 in 0.348s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fb38ecec-65d1-4fae-b80e-61567ece0439 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:17 devstack sudo[98283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a.info Sep 28 18:14:17 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:17 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fb38ecec-65d1-4fae-b80e-61567ece0439 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a.info" returned: 0 in 0.458s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:17 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-fb38ecec-65d1-4fae-b80e-61567ece0439 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a.info is being set with open permissions: ugo+rw Sep 28 18:14:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fb38ecec-65d1-4fae-b80e-61567ece0439 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:17 devstack sudo[98289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a.info Sep 28 18:14:17 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:18 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Flow 'volume_create_manager' (59ecd955-7389-4441-8926-7f417c1fbc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4897c2b0-0657-4285-acdc-f6d5cf7257e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4897c2b0-0657-4285-acdc-f6d5cf7257e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1343035794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b48c889-6040-4f20-8c75-3fb9170abcc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0472e44d4ac4f8eb12c8d41977fb14a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:18Z,use_quota=True,user_id='18fb23ccf65d46d9ba7220403e135f13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0399c72-39f1-4584-b53f-1aaa8f498c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0399c72-39f1-4584-b53f-1aaa8f498c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9add2e4a-429d-4dbb-9f7e-27a950700bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9add2e4a-429d-4dbb-9f7e-27a950700bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b48c889-6040-4f20-8c75-3fb9170abcc8', 'volume_name': 'volume-1b48c889-6040-4f20-8c75-3fb9170abcc8', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d663bb7-3e7e-4602-b927-8ac790b94cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d663bb7-3e7e-4602-b927-8ac790b94cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:18 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (193d08fb-754a-4abf-9b68-a9887a8e4e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:18 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Volume 1b48c889-6040-4f20-8c75-3fb9170abcc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b48c889-6040-4f20-8c75-3fb9170abcc8', 'volume_size': 1} Sep 28 18:14:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fb38ecec-65d1-4fae-b80e-61567ece0439 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a.info" returned: 0 in 0.365s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-fb38ecec-65d1-4fae-b80e-61567ece0439 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.139s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.135s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-935427128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a91805d-b326-416a-9d78-88abd23b9cfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88993609c5f043e3bf11bd9c33a8f0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:09Z,use_quota=True,user_id='98711139681b4130b6ab7f4fc972bb6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08688770-9dda-4df5-905e-e197c3e22064),volume_type_id=08688770-9dda-4df5-905e-e197c3e22064)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Creating volume 2a91805d-b326-416a-9d78-88abd23b9cfb {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:18 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:14:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a91805d-b326-416a-9d78-88abd23b9cfb 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:18 devstack sudo[98292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a91805d-b326-416a-9d78-88abd23b9cfb 1073741824 Sep 28 18:14:18 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:18 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-fb38ecec-65d1-4fae-b80e-61567ece0439 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Create snapshot completed successfully Sep 28 18:14:18 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a91805d-b326-416a-9d78-88abd23b9cfb 1073741824" returned: 0 in 0.618s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a91805d-b326-416a-9d78-88abd23b9cfb {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:18 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a91805d-b326-416a-9d78-88abd23b9cfb Sep 28 18:14:18 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:19 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a91805d-b326-416a-9d78-88abd23b9cfb" returned: 0 in 0.389s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.112s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1343035794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b48c889-6040-4f20-8c75-3fb9170abcc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0472e44d4ac4f8eb12c8d41977fb14a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:18Z,use_quota=True,user_id='18fb23ccf65d46d9ba7220403e135f13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Creating volume 1b48c889-6040-4f20-8c75-3fb9170abcc8 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:19 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:14:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1b48c889-6040-4f20-8c75-3fb9170abcc8 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:19 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Attempting download of 42d5558a-bcde-48e4-9b4b-5abad9bb9c78 ((None, [{'url': 'file:///opt/stack/data/glance/images/42d5558a-bcde-48e4-9b4b-5abad9bb9c78', 'metadata': {}}])) to volume 2a91805d-b326-416a-9d78-88abd23b9cfb. {{(pid=86980) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:14:19 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1b48c889-6040-4f20-8c75-3fb9170abcc8 1073741824 Sep 28 18:14:19 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:19 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[164a1933-6c3b-4a1c-af0d-2731cf98edf3]: (4, 'raw') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_42d5558a-bcde-48e4-9b4b-5abad9bb9c78_0pnpddhb {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:19 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a881f5b2-c8a2-4768-bb3f-fb353ee1d228 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Acquiring lock "cinder-3a3ec7d1-86a3-4f24-a442-e5ed61c08e7e-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:19 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a881f5b2-c8a2-4768-bb3f-fb353ee1d228 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Lock "cinder-3a3ec7d1-86a3-4f24-a442-e5ed61c08e7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:19 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a881f5b2-c8a2-4768-bb3f-fb353ee1d228 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Acquiring lock "cinder-quobyte-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:19 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a881f5b2-c8a2-4768-bb3f-fb353ee1d228 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Lock "cinder-quobyte-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:19 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a881f5b2-c8a2-4768-bb3f-fb353ee1d228 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Acquiring lock "cinder-quobyte-3a3ec7d1-86a3-4f24-a442-e5ed61c08e7e" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:19 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a881f5b2-c8a2-4768-bb3f-fb353ee1d228 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Lock "cinder-quobyte-3a3ec7d1-86a3-4f24-a442-e5ed61c08e7e" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-a881f5b2-c8a2-4768-bb3f-fb353ee1d228 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Deleting offline snapshot 3a3ec7d1-86a3-4f24-a442-e5ed61c08e7e of volume b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:14:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-a881f5b2-c8a2-4768-bb3f-fb353ee1d228 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] snapshot_file for this snap is: volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a.3a3ec7d1-86a3-4f24-a442-e5ed61c08e7e {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:14:19 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_42d5558a-bcde-48e4-9b4b-5abad9bb9c78_0pnpddhb Sep 28 18:14:19 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:19 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce232ce-ba24-4a53-a291-45f231ef1f35]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a881f5b2-c8a2-4768-bb3f-fb353ee1d228 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a.3a3ec7d1-86a3-4f24-a442-e5ed61c08e7e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:19 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a.3a3ec7d1-86a3-4f24-a442-e5ed61c08e7e Sep 28 18:14:19 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:20 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_42d5558a-bcde-48e4-9b4b-5abad9bb9c78_0pnpddhb" returned: 0 in 0.619s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_42d5558a-bcde-48e4-9b4b-5abad9bb9c78_0pnpddhb {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:20 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1b48c889-6040-4f20-8c75-3fb9170abcc8 1073741824" returned: 0 in 0.829s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1b48c889-6040-4f20-8c75-3fb9170abcc8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:20 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1b48c889-6040-4f20-8c75-3fb9170abcc8 Sep 28 18:14:20 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:20 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_42d5558a-bcde-48e4-9b4b-5abad9bb9c78_0pnpddhb Sep 28 18:14:20 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:20 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a881f5b2-c8a2-4768-bb3f-fb353ee1d228 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a.3a3ec7d1-86a3-4f24-a442-e5ed61c08e7e" returned: 0 in 0.772s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:20 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-a881f5b2-c8a2-4768-bb3f-fb353ee1d228 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:14:20 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffec10a-de05-469e-a4fe-e3959d923afc]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a881f5b2-c8a2-4768-bb3f-fb353ee1d228 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:20 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1b48c889-6040-4f20-8c75-3fb9170abcc8" returned: 0 in 0.413s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:20 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:20 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a Sep 28 18:14:20 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (193d08fb-754a-4abf-9b68-a9887a8e4e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b48c889-6040-4f20-8c75-3fb9170abcc8', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3149ced2-ae24-4bd9-a5fc-48791d8abd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:20 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_42d5558a-bcde-48e4-9b4b-5abad9bb9c78_0pnpddhb" returned: 1 in 0.639s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_42d5558a-bcde-48e4-9b4b-5abad9bb9c78_0pnpddhb' failed. Not Retrying. {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:14:20 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed3b5d2-f144-462b-9617-05027eee5648]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_42d5558a-bcde-48e4-9b4b-5abad9bb9c78_x3cpo682devstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:20 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Volume volume-1b48c889-6040-4f20-8c75-3fb9170abcc8 (1b48c889-6040-4f20-8c75-3fb9170abcc8): created successfully Sep 28 18:14:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3149ced2-ae24-4bd9-a5fc-48791d8abd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Flow 'volume_create_manager' (59ecd955-7389-4441-8926-7f417c1fbc9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:20 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-7756989d-7ba4-46d5-bebb-87dcebf9bd84 tempest-VolumesTransfersV355Test-1799920160 None] Created volume successfully. Sep 28 18:14:20 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_42d5558a-bcde-48e4-9b4b-5abad9bb9c78_x3cpo682devstack@QuobyteHD Sep 28 18:14:20 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:21 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a881f5b2-c8a2-4768-bb3f-fb353ee1d228 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a" returned: 0 in 0.572s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a881f5b2-c8a2-4768-bb3f-fb353ee1d228 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a.3a3ec7d1-86a3-4f24-a442-e5ed61c08e7e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:21 devstack sudo[98346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a.3a3ec7d1-86a3-4f24-a442-e5ed61c08e7e Sep 28 18:14:21 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:21 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_42d5558a-bcde-48e4-9b4b-5abad9bb9c78_x3cpo682devstack@QuobyteHD" returned: 0 in 0.450s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:21 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] 42d5558a-bcde-48e4-9b4b-5abad9bb9c78 was qcow2, converting to qcow2 {{(pid=86980) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:14:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_42d5558a-bcde-48e4-9b4b-5abad9bb9c78_x3cpo682devstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a91805d-b326-416a-9d78-88abd23b9cfb {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:21 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_42d5558a-bcde-48e4-9b4b-5abad9bb9c78_x3cpo682devstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a91805d-b326-416a-9d78-88abd23b9cfb Sep 28 18:14:21 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:21 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a881f5b2-c8a2-4768-bb3f-fb353ee1d228 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a.3a3ec7d1-86a3-4f24-a442-e5ed61c08e7e" returned: 0 in 0.545s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a881f5b2-c8a2-4768-bb3f-fb353ee1d228 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a.3a3ec7d1-86a3-4f24-a442-e5ed61c08e7e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:21 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a.3a3ec7d1-86a3-4f24-a442-e5ed61c08e7e Sep 28 18:14:21 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:21 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0144ac5f-9d4b-4bdc-832c-c76b216c7678 tempest-VolumesTransfersV355Test-580149687 None] Acquiring lock "cinder-1b48c889-6040-4f20-8c75-3fb9170abcc8-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:21 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0144ac5f-9d4b-4bdc-832c-c76b216c7678 tempest-VolumesTransfersV355Test-580149687 None] Lock "cinder-1b48c889-6040-4f20-8c75-3fb9170abcc8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:21 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a881f5b2-c8a2-4768-bb3f-fb353ee1d228 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a.3a3ec7d1-86a3-4f24-a442-e5ed61c08e7e" returned: 0 in 0.393s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:22 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a881f5b2-c8a2-4768-bb3f-fb353ee1d228 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Lock "cinder-quobyte-3a3ec7d1-86a3-4f24-a442-e5ed61c08e7e" released by "_delete_snapshot" :: held 2.502s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:22 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0144ac5f-9d4b-4bdc-832c-c76b216c7678 tempest-VolumesTransfersV355Test-580149687 None] Acquiring lock "cinder-quobyte-1b48c889-6040-4f20-8c75-3fb9170abcc8" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:22 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a881f5b2-c8a2-4768-bb3f-fb353ee1d228 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Lock "cinder-quobyte-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a" released by "delete_snapshot" :: held 2.559s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:22 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0144ac5f-9d4b-4bdc-832c-c76b216c7678 tempest-VolumesTransfersV355Test-580149687 None] Lock "cinder-quobyte-1b48c889-6040-4f20-8c75-3fb9170abcc8" acquired by "delete_volume" :: waited 0.036s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:22 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cbe36c-5251-4a26-96ab-dadeafa3c7ac]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0144ac5f-9d4b-4bdc-832c-c76b216c7678 tempest-VolumesTransfersV355Test-580149687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1b48c889-6040-4f20-8c75-3fb9170abcc8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:22 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-a881f5b2-c8a2-4768-bb3f-fb353ee1d228 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Created reservations ['006f3ab9-3419-44bb-9376-a197bcc7f262', 'ec164ca0-cee2-4be8-94d5-0d7953a279ec', 'cdde5491-8176-4382-ab65-0b489a4526c6', '839d3b78-dac7-4ca3-b7c9-c76d50092767'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:22 devstack sudo[98366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1b48c889-6040-4f20-8c75-3fb9170abcc8 Sep 28 18:14:22 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:22 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-a881f5b2-c8a2-4768-bb3f-fb353ee1d228 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Delete snapshot completed successfully. Sep 28 18:14:22 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a881f5b2-c8a2-4768-bb3f-fb353ee1d228 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Lock "cinder-3a3ec7d1-86a3-4f24-a442-e5ed61c08e7e-delete_snapshot" released by "delete_snapshot" :: held 2.865s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:22 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0144ac5f-9d4b-4bdc-832c-c76b216c7678 tempest-VolumesTransfersV355Test-580149687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1b48c889-6040-4f20-8c75-3fb9170abcc8" returned: 0 in 0.657s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0144ac5f-9d4b-4bdc-832c-c76b216c7678 tempest-VolumesTransfersV355Test-580149687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1b48c889-6040-4f20-8c75-3fb9170abcc8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:22 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1b48c889-6040-4f20-8c75-3fb9170abcc8 Sep 28 18:14:22 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:22 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-be8c6354-657f-452a-9a6c-da2b4c513959 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Acquiring lock "cinder-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:22 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-be8c6354-657f-452a-9a6c-da2b4c513959 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Lock "cinder-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-be8c6354-657f-452a-9a6c-da2b4c513959 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Acquiring lock "cinder-quobyte-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-be8c6354-657f-452a-9a6c-da2b4c513959 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Lock "cinder-quobyte-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a" acquired by "delete_volume" :: waited 0.029s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:23 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4434c2c5-641b-4b55-9538-4dc40ac0cae9]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-be8c6354-657f-452a-9a6c-da2b4c513959 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:23 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0144ac5f-9d4b-4bdc-832c-c76b216c7678 tempest-VolumesTransfersV355Test-580149687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1b48c889-6040-4f20-8c75-3fb9170abcc8" returned: 0 in 0.540s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:23 devstack sudo[98377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a Sep 28 18:14:23 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0144ac5f-9d4b-4bdc-832c-c76b216c7678 tempest-VolumesTransfersV355Test-580149687 None] Lock "cinder-quobyte-1b48c889-6040-4f20-8c75-3fb9170abcc8" released by "delete_volume" :: held 1.270s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:23 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-0144ac5f-9d4b-4bdc-832c-c76b216c7678 tempest-VolumesTransfersV355Test-580149687 None] Created reservations ['71d26e71-5301-4dde-8ec8-392de3d2c1f9', '4bc77b18-020f-4e0b-a36a-90788ac11784', '8a46a644-5048-4d60-8612-7d110d13494a', '61f9c63c-1b33-4f13-afaa-41ea777e1302'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0144ac5f-9d4b-4bdc-832c-c76b216c7678 tempest-VolumesTransfersV355Test-580149687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0144ac5f-9d4b-4bdc-832c-c76b216c7678 tempest-VolumesTransfersV355Test-580149687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0144ac5f-9d4b-4bdc-832c-c76b216c7678 tempest-VolumesTransfersV355Test-580149687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0144ac5f-9d4b-4bdc-832c-c76b216c7678 tempest-VolumesTransfersV355Test-580149687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0144ac5f-9d4b-4bdc-832c-c76b216c7678 tempest-VolumesTransfersV355Test-580149687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0144ac5f-9d4b-4bdc-832c-c76b216c7678 tempest-VolumesTransfersV355Test-580149687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:23 devstack sudo[98382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:14:23 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-be8c6354-657f-452a-9a6c-da2b4c513959 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a" returned: 0 in 0.658s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-be8c6354-657f-452a-9a6c-da2b4c513959 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:23 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:23 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a Sep 28 18:14:23 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:24 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0144ac5f-9d4b-4bdc-832c-c76b216c7678 tempest-VolumesTransfersV355Test-580149687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.621s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:24 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-0144ac5f-9d4b-4bdc-832c-c76b216c7678 tempest-VolumesTransfersV355Test-580149687 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:24 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-0144ac5f-9d4b-4bdc-832c-c76b216c7678 tempest-VolumesTransfersV355Test-580149687 None] Deleted volume successfully. Sep 28 18:14:24 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0144ac5f-9d4b-4bdc-832c-c76b216c7678 tempest-VolumesTransfersV355Test-580149687 None] Lock "cinder-1b48c889-6040-4f20-8c75-3fb9170abcc8-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:24 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-be8c6354-657f-452a-9a6c-da2b4c513959 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a" returned: 0 in 0.671s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:24 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-be8c6354-657f-452a-9a6c-da2b4c513959 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Lock "cinder-quobyte-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a" released by "delete_volume" :: held 1.484s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:24 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-be8c6354-657f-452a-9a6c-da2b4c513959 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Created reservations ['e05c4054-aa60-4d94-90a1-bb6ee74d471e', '1f6f882f-8dcf-4a8b-884f-e7d31dfb9c3b', '43f0e9f8-1944-4dda-b3d5-6941f12ab21f', 'a5c18c01-cd65-4af2-9844-ab5c13d7522e'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:24 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_42d5558a-bcde-48e4-9b4b-5abad9bb9c78_x3cpo682devstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a91805d-b326-416a-9d78-88abd23b9cfb" returned: 0 in 3.692s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:24 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_42d5558a-bcde-48e4-9b4b-5abad9bb9c78_x3cpo682devstack@QuobyteHD, size 112.00 MB, duration 3.70 sec, destination /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a91805d-b326-416a-9d78-88abd23b9cfb {{(pid=86980) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:14:24 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Converted 112.00 MB image at 30.29 MB/s Sep 28 18:14:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a91805d-b326-416a-9d78-88abd23b9cfb 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-be8c6354-657f-452a-9a6c-da2b4c513959 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-be8c6354-657f-452a-9a6c-da2b4c513959 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:24 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-be8c6354-657f-452a-9a6c-da2b4c513959 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:24 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-be8c6354-657f-452a-9a6c-da2b4c513959 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-be8c6354-657f-452a-9a6c-da2b4c513959 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-be8c6354-657f-452a-9a6c-da2b4c513959 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:24 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a91805d-b326-416a-9d78-88abd23b9cfb 1G Sep 28 18:14:24 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:24 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:14:24 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:25 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-be8c6354-657f-452a-9a6c-da2b4c513959 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.623s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:25 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-be8c6354-657f-452a-9a6c-da2b4c513959 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:25 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-be8c6354-657f-452a-9a6c-da2b4c513959 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Deleted volume successfully. Sep 28 18:14:25 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-be8c6354-657f-452a-9a6c-da2b4c513959 tempest-VolumesSnapshotNegativeTestJSON-585169005 None] Lock "cinder-b7ee2fc7-e4ff-4cfa-b6c8-8bc3d3fceb2a-delete_volume" released by "delete_volume" :: held 2.651s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:25 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a91805d-b326-416a-9d78-88abd23b9cfb 1G" returned: 0 in 0.761s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:25 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Downloaded image 42d5558a-bcde-48e4-9b4b-5abad9bb9c78 ((None, [{'url': 'file:///opt/stack/data/glance/images/42d5558a-bcde-48e4-9b4b-5abad9bb9c78', 'metadata': {}}])) to volume 2a91805d-b326-416a-9d78-88abd23b9cfb successfully. {{(pid=86980) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:14:25 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Temporary image 42d5558a-bcde-48e4-9b4b-5abad9bb9c78 for user 98711139681b4130b6ab7f4fc972bb6b is deleted. {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:14:25 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Marking volume 2a91805d-b326-416a-9d78-88abd23b9cfb as bootable. {{(pid=86980) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:14:25 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Copying metadata from image 42d5558a-bcde-48e4-9b4b-5abad9bb9c78 to 2a91805d-b326-416a-9d78-88abd23b9cfb. {{(pid=86980) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:14:25 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Creating volume glance metadata for volume 2a91805d-b326-416a-9d78-88abd23b9cfb backed by image 42d5558a-bcde-48e4-9b4b-5abad9bb9c78 with: {'image_id': '42d5558a-bcde-48e4-9b4b-5abad9bb9c78', 'image_name': 'tempest-scenario-img--1742255051', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86980) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:14:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d954c56-f8b2-4760-a8d9-dae5cc112a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a91805d-b326-416a-9d78-88abd23b9cfb', 'volume_size': 1, 'image_id': '42d5558a-bcde-48e4-9b4b-5abad9bb9c78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/42d5558a-bcde-48e4-9b4b-5abad9bb9c78', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1742255051', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88993609c5f043e3bf11bd9c33a8f0f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '42d5558a-bcde-48e4-9b4b-5abad9bb9c78', 'created_at': datetime.datetime(2026, 9, 28, 16, 14, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 14, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/42d5558a-bcde-48e4-9b4b-5abad9bb9c78/file', 'properties': {}}, 'image_service': }' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754dcb24-2944-4e6f-a692-a99781f889ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:25 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Volume volume-2a91805d-b326-416a-9d78-88abd23b9cfb (2a91805d-b326-416a-9d78-88abd23b9cfb): created successfully Sep 28 18:14:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754dcb24-2944-4e6f-a692-a99781f889ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Flow 'volume_create_manager' (bc01fded-e59d-4883-9c00-d1d5346932f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:25 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-b30f528d-a7f5-42c8-a40b-fff799565fec tempest-TestInstancesWithCinderVolumes-359587429 None] Created volume successfully. Sep 28 18:14:32 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=83,cinder:INSERT=33,cinder:UPDATE=114,cinder:DELETE=7 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:14:32 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=83,cinder:UPDATE=102,cinder:DELETE=12,cinder:INSERT=27 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:14:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-6674f06e-6b3c-40a2-b3d4-06eeba0b693e req-c75848f5-a764-4476-95da-fbac6e14cd5e tempest-TestInstancesWithCinderVolumes-359587429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-6674f06e-6b3c-40a2-b3d4-06eeba0b693e req-c75848f5-a764-4476-95da-fbac6e14cd5e tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-6674f06e-6b3c-40a2-b3d4-06eeba0b693e req-c75848f5-a764-4476-95da-fbac6e14cd5e tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:32 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-6674f06e-6b3c-40a2-b3d4-06eeba0b693e req-c75848f5-a764-4476-95da-fbac6e14cd5e tempest-TestInstancesWithCinderVolumes-359587429 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729', 'name': 'volume-2a91805d-b326-416a-9d78-88abd23b9cfb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2b1cb75-9a33-4a9f-ad90-dd35337adcf7', 'enforce_multipath': True} {{(pid=86980) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:14:32 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-6674f06e-6b3c-40a2-b3d4-06eeba0b693e req-c75848f5-a764-4476-95da-fbac6e14cd5e tempest-TestInstancesWithCinderVolumes-359587429 None] attachment_update completed successfully. Sep 28 18:14:38 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Flow 'volume_create_manager' (4401862a-6e99-419a-9c15-e7e753962b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52f2c119-2157-4315-a3c2-121b8bac0554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52f2c119-2157-4315-a3c2-121b8bac0554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-257989508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad2ca451-7ff6-4b38-be5a-6c91331d9436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19601c949c4e4af495024845c8125a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:38Z,use_quota=True,user_id='1f7b4073c36a43b08222414445213a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0342465c-40b0-465a-9a98-0cc0d09a3e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0342465c-40b0-465a-9a98-0cc0d09a3e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (420899ac-090a-4e08-b363-33058f0e80ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (420899ac-090a-4e08-b363-33058f0e80ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad2ca451-7ff6-4b38-be5a-6c91331d9436', 'volume_name': 'volume-ad2ca451-7ff6-4b38-be5a-6c91331d9436', 'volume_size': 2}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300c6cc7-a0e5-4085-82fb-5914503885ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300c6cc7-a0e5-4085-82fb-5914503885ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38562456-f490-45d1-a5bd-01080da89001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:38 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Volume ad2ca451-7ff6-4b38-be5a-6c91331d9436: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad2ca451-7ff6-4b38-be5a-6c91331d9436', 'volume_size': 2} Sep 28 18:14:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-257989508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad2ca451-7ff6-4b38-be5a-6c91331d9436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19601c949c4e4af495024845c8125a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:38Z,use_quota=True,user_id='1f7b4073c36a43b08222414445213a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Creating volume ad2ca451-7ff6-4b38-be5a-6c91331d9436 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:38 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:14:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ad2ca451-7ff6-4b38-be5a-6c91331d9436 2147483648 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:38 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ad2ca451-7ff6-4b38-be5a-6c91331d9436 2147483648 Sep 28 18:14:38 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:39 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ad2ca451-7ff6-4b38-be5a-6c91331d9436 2147483648" returned: 0 in 0.892s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ad2ca451-7ff6-4b38-be5a-6c91331d9436 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:39 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ad2ca451-7ff6-4b38-be5a-6c91331d9436 Sep 28 18:14:39 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:39 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ad2ca451-7ff6-4b38-be5a-6c91331d9436" returned: 0 in 0.629s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38562456-f490-45d1-a5bd-01080da89001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad2ca451-7ff6-4b38-be5a-6c91331d9436', 'volume_size': 2}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4d680d-fa37-43b9-82f7-1c54d729a16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:39 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Volume volume-ad2ca451-7ff6-4b38-be5a-6c91331d9436 (ad2ca451-7ff6-4b38-be5a-6c91331d9436): created successfully Sep 28 18:14:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4d680d-fa37-43b9-82f7-1c54d729a16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Flow 'volume_create_manager' (4401862a-6e99-419a-9c15-e7e753962b80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:39 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-a504dd1e-b95c-41cb-aeac-0fd44ae15b8e tempest-VolumesCloneNegativeTest-1230910469 None] Created volume successfully. Sep 28 18:14:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6faf1b3e-6b6b-4c23-96fa-b615940b3f5f tempest-VolumesCloneNegativeTest-1230910469 None] Acquiring lock "cinder-ad2ca451-7ff6-4b38-be5a-6c91331d9436-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6faf1b3e-6b6b-4c23-96fa-b615940b3f5f tempest-VolumesCloneNegativeTest-1230910469 None] Lock "cinder-ad2ca451-7ff6-4b38-be5a-6c91331d9436-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6faf1b3e-6b6b-4c23-96fa-b615940b3f5f tempest-VolumesCloneNegativeTest-1230910469 None] Acquiring lock "cinder-quobyte-ad2ca451-7ff6-4b38-be5a-6c91331d9436" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6faf1b3e-6b6b-4c23-96fa-b615940b3f5f tempest-VolumesCloneNegativeTest-1230910469 None] Lock "cinder-quobyte-ad2ca451-7ff6-4b38-be5a-6c91331d9436" acquired by "delete_volume" :: waited 0.048s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:41 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aed6905-e442-45cc-a1a2-97bff06f2d39]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6faf1b3e-6b6b-4c23-96fa-b615940b3f5f tempest-VolumesCloneNegativeTest-1230910469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ad2ca451-7ff6-4b38-be5a-6c91331d9436 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:41 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ad2ca451-7ff6-4b38-be5a-6c91331d9436 Sep 28 18:14:41 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:41 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6faf1b3e-6b6b-4c23-96fa-b615940b3f5f tempest-VolumesCloneNegativeTest-1230910469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ad2ca451-7ff6-4b38-be5a-6c91331d9436" returned: 0 in 0.853s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6faf1b3e-6b6b-4c23-96fa-b615940b3f5f tempest-VolumesCloneNegativeTest-1230910469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ad2ca451-7ff6-4b38-be5a-6c91331d9436 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:41 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ad2ca451-7ff6-4b38-be5a-6c91331d9436 Sep 28 18:14:41 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:42 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6faf1b3e-6b6b-4c23-96fa-b615940b3f5f tempest-VolumesCloneNegativeTest-1230910469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ad2ca451-7ff6-4b38-be5a-6c91331d9436" returned: 0 in 0.490s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6faf1b3e-6b6b-4c23-96fa-b615940b3f5f tempest-VolumesCloneNegativeTest-1230910469 None] Lock "cinder-quobyte-ad2ca451-7ff6-4b38-be5a-6c91331d9436" released by "delete_volume" :: held 1.426s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:42 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-6faf1b3e-6b6b-4c23-96fa-b615940b3f5f tempest-VolumesCloneNegativeTest-1230910469 None] Created reservations ['24ce275b-8871-4703-8ed9-56f664b0d531', '4e0bc4df-72d6-48d9-95ee-1cd4086c69b6', 'dc55589c-854b-40d5-b805-a7ef37b9c6f7', 'fbe8774a-1b36-4b14-ac56-d28d10151fc4'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:14:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6faf1b3e-6b6b-4c23-96fa-b615940b3f5f tempest-VolumesCloneNegativeTest-1230910469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6faf1b3e-6b6b-4c23-96fa-b615940b3f5f tempest-VolumesCloneNegativeTest-1230910469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6faf1b3e-6b6b-4c23-96fa-b615940b3f5f tempest-VolumesCloneNegativeTest-1230910469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6faf1b3e-6b6b-4c23-96fa-b615940b3f5f tempest-VolumesCloneNegativeTest-1230910469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6faf1b3e-6b6b-4c23-96fa-b615940b3f5f tempest-VolumesCloneNegativeTest-1230910469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6faf1b3e-6b6b-4c23-96fa-b615940b3f5f tempest-VolumesCloneNegativeTest-1230910469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:42 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:14:42 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:43 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6faf1b3e-6b6b-4c23-96fa-b615940b3f5f tempest-VolumesCloneNegativeTest-1230910469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.409s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:43 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6faf1b3e-6b6b-4c23-96fa-b615940b3f5f tempest-VolumesCloneNegativeTest-1230910469 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:14:43 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-6faf1b3e-6b6b-4c23-96fa-b615940b3f5f tempest-VolumesCloneNegativeTest-1230910469 None] Deleted volume successfully. Sep 28 18:14:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6faf1b3e-6b6b-4c23-96fa-b615940b3f5f tempest-VolumesCloneNegativeTest-1230910469 None] Lock "cinder-ad2ca451-7ff6-4b38-be5a-6c91331d9436-delete_volume" released by "delete_volume" :: held 2.286s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:14:50 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Flow 'volume_create_manager' (4cd23599-ee9f-46d8-9cac-6f38d06b4452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b274b3-d56d-4f0f-92c6-387935489ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b274b3-d56d-4f0f-92c6-387935489ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1940618520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b4a82d-20dd-43aa-b2d1-60376157a75b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3acbf75f6a084113bb27c4f95674b305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:51Z,use_quota=True,user_id='394b2daed20c40368659402b44a6a650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64342390-aeff-434d-a8f8-fd8c70c553c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64342390-aeff-434d-a8f8-fd8c70c553c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d52b6d2-d36b-4bef-8c64-34aa425ba1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d52b6d2-d36b-4bef-8c64-34aa425ba1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13b4a82d-20dd-43aa-b2d1-60376157a75b', 'volume_name': 'volume-13b4a82d-20dd-43aa-b2d1-60376157a75b', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69681406-2287-4360-97bd-d266dd24689f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69681406-2287-4360-97bd-d266dd24689f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6415c85c-2542-476f-9202-6c7bfedd2415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:51 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Volume 13b4a82d-20dd-43aa-b2d1-60376157a75b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13b4a82d-20dd-43aa-b2d1-60376157a75b', 'volume_size': 1} Sep 28 18:14:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:51 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1940618520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b4a82d-20dd-43aa-b2d1-60376157a75b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3acbf75f6a084113bb27c4f95674b305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:51Z,use_quota=True,user_id='394b2daed20c40368659402b44a6a650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:51 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Creating volume 13b4a82d-20dd-43aa-b2d1-60376157a75b {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:51 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:51 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:51 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:51 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:14:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-13b4a82d-20dd-43aa-b2d1-60376157a75b 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:51 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-13b4a82d-20dd-43aa-b2d1-60376157a75b 1073741824 Sep 28 18:14:51 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:51 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-13b4a82d-20dd-43aa-b2d1-60376157a75b 1073741824" returned: 0 in 0.825s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-13b4a82d-20dd-43aa-b2d1-60376157a75b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:52 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-13b4a82d-20dd-43aa-b2d1-60376157a75b Sep 28 18:14:52 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:52 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-13b4a82d-20dd-43aa-b2d1-60376157a75b" returned: 0 in 0.509s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:52 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6415c85c-2542-476f-9202-6c7bfedd2415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13b4a82d-20dd-43aa-b2d1-60376157a75b', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9982d06c-7e7d-465d-915c-b3cec38cfba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:52 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Volume volume-13b4a82d-20dd-43aa-b2d1-60376157a75b (13b4a82d-20dd-43aa-b2d1-60376157a75b): created successfully Sep 28 18:14:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9982d06c-7e7d-465d-915c-b3cec38cfba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Flow 'volume_create_manager' (4cd23599-ee9f-46d8-9cac-6f38d06b4452) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:52 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-e70e2a05-c0bf-4019-9504-44f5cc8b6b24 tempest-VolumesGetTest-1204405293 None] Created volume successfully. Sep 28 18:14:54 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Flow 'volume_create_manager' (c35d2c0e-b268-4f12-9b21-a44ee41df141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f1311da-670c-44d7-a14c-b167211e1827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f1311da-670c-44d7-a14c-b167211e1827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1471046670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=882d5f79-65b6-483d-880f-54bd497d3a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22a1fe44f79a46519fcb0b238e16c192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:55Z,use_quota=True,user_id='91f10fdc436d495cbbbf80b57a95a973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00f52a4-aa13-4e08-b942-75fe0ead6179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00f52a4-aa13-4e08-b942-75fe0ead6179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5beb62-a0a4-407b-bd67-7f6e1d2dcd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5beb62-a0a4-407b-bd67-7f6e1d2dcd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '882d5f79-65b6-483d-880f-54bd497d3a61', 'volume_name': 'volume-882d5f79-65b6-483d-880f-54bd497d3a61', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cdf55a5-c786-4071-b958-551fec2c21a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cdf55a5-c786-4071-b958-551fec2c21a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc9d3c7-b228-4ca5-93f4-da005b041d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:54 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Volume 882d5f79-65b6-483d-880f-54bd497d3a61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-882d5f79-65b6-483d-880f-54bd497d3a61', 'volume_size': 1} Sep 28 18:14:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1471046670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=882d5f79-65b6-483d-880f-54bd497d3a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22a1fe44f79a46519fcb0b238e16c192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:55Z,use_quota=True,user_id='91f10fdc436d495cbbbf80b57a95a973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Creating volume 882d5f79-65b6-483d-880f-54bd497d3a61 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:55 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:55 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:55 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:55 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:14:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-882d5f79-65b6-483d-880f-54bd497d3a61 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:55 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-882d5f79-65b6-483d-880f-54bd497d3a61 1073741824 Sep 28 18:14:55 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:55 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:14:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Flow 'volume_create_manager' (1d14facc-f445-4dd9-8a90-ed68f0d18b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71170b71-9bab-4e85-9efb-bdbedde4a37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71170b71-9bab-4e85-9efb-bdbedde4a37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1412365930',display_name='tempest-VolumesGetTest-Volume-1812849931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2935c402-f063-4f40-9799-e2183b86d987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3acbf75f6a084113bb27c4f95674b305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:56Z,use_quota=True,user_id='394b2daed20c40368659402b44a6a650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf47ab49-0371-4f40-a659-efc4e3b2daee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf47ab49-0371-4f40-a659-efc4e3b2daee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1965524e-b2da-4a83-9e23-0fb3ef346078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1965524e-b2da-4a83-9e23-0fb3ef346078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2935c402-f063-4f40-9799-e2183b86d987', 'volume_name': 'volume-2935c402-f063-4f40-9799-e2183b86d987', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e48c2b-5c5d-4972-b97d-bf665c636ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e48c2b-5c5d-4972-b97d-bf665c636ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ab86c0-7b06-4c40-824c-7bf934a65ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:55 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Volume 2935c402-f063-4f40-9799-e2183b86d987: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2935c402-f063-4f40-9799-e2183b86d987', 'volume_size': 1} Sep 28 18:14:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:55 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-882d5f79-65b6-483d-880f-54bd497d3a61 1073741824" returned: 0 in 0.935s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-882d5f79-65b6-483d-880f-54bd497d3a61 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:56 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-882d5f79-65b6-483d-880f-54bd497d3a61 Sep 28 18:14:56 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:56 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-882d5f79-65b6-483d-880f-54bd497d3a61" returned: 0 in 0.436s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.611s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:14:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1412365930',display_name='tempest-VolumesGetTest-Volume-1812849931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2935c402-f063-4f40-9799-e2183b86d987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3acbf75f6a084113bb27c4f95674b305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:14:56Z,use_quota=True,user_id='394b2daed20c40368659402b44a6a650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:14:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Creating volume 2935c402-f063-4f40-9799-e2183b86d987 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:14:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:14:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:14:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:14:56 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:14:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2935c402-f063-4f40-9799-e2183b86d987 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc9d3c7-b228-4ca5-93f4-da005b041d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-882d5f79-65b6-483d-880f-54bd497d3a61', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a647502e-2a4b-48c0-add6-f30ae83e7d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:56 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Volume volume-882d5f79-65b6-483d-880f-54bd497d3a61 (882d5f79-65b6-483d-880f-54bd497d3a61): created successfully Sep 28 18:14:56 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2935c402-f063-4f40-9799-e2183b86d987 1073741824 Sep 28 18:14:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a647502e-2a4b-48c0-add6-f30ae83e7d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:56 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Flow 'volume_create_manager' (c35d2c0e-b268-4f12-9b21-a44ee41df141) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:56 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-cb3f77ad-d5a1-46d4-8c7c-445649ada817 tempest-AttachVolumeNegativeTest-1060566598 None] Created volume successfully. Sep 28 18:14:57 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2935c402-f063-4f40-9799-e2183b86d987 1073741824" returned: 0 in 0.963s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2935c402-f063-4f40-9799-e2183b86d987 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:57 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2935c402-f063-4f40-9799-e2183b86d987 Sep 28 18:14:57 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:14:58 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Sep 28 18:14:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2935c402-f063-4f40-9799-e2183b86d987" returned: 0 in 0.650s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:14:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:14:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ab86c0-7b06-4c40-824c-7bf934a65ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2935c402-f063-4f40-9799-e2183b86d987', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fbbac2f-f17a-45cd-a542-06ddc3a39d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:14:58 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Volume volume-2935c402-f063-4f40-9799-e2183b86d987 (2935c402-f063-4f40-9799-e2183b86d987): created successfully Sep 28 18:14:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fbbac2f-f17a-45cd-a542-06ddc3a39d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:14:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Flow 'volume_create_manager' (1d14facc-f445-4dd9-8a90-ed68f0d18b4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:14:58 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-63a8a810-17e5-4803-bf2c-ce73c176cd98 tempest-VolumesGetTest-1204405293 None] Created volume successfully. Sep 28 18:14:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-e4ec20ea-16c5-4e1e-9012-5e64d8f2a61d req-fce4bc8d-d295-43c8-a3dc-a24f22f1df51 tempest-AttachVolumeNegativeTest-1060566598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:14:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-e4ec20ea-16c5-4e1e-9012-5e64d8f2a61d req-fce4bc8d-d295-43c8-a3dc-a24f22f1df51 tempest-AttachVolumeNegativeTest-1060566598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:14:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-e4ec20ea-16c5-4e1e-9012-5e64d8f2a61d req-fce4bc8d-d295-43c8-a3dc-a24f22f1df51 tempest-AttachVolumeNegativeTest-1060566598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:14:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-e4ec20ea-16c5-4e1e-9012-5e64d8f2a61d req-fce4bc8d-d295-43c8-a3dc-a24f22f1df51 tempest-AttachVolumeNegativeTest-1060566598 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729', 'name': 'volume-882d5f79-65b6-483d-880f-54bd497d3a61', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd92f80f1-4d4f-49cc-a55c-646ccc12e768', 'enforce_multipath': True} {{(pid=86980) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:14:58 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-e4ec20ea-16c5-4e1e-9012-5e64d8f2a61d req-fce4bc8d-d295-43c8-a3dc-a24f22f1df51 tempest-AttachVolumeNegativeTest-1060566598 None] attachment_update completed successfully. Sep 28 18:14:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-be7f535a-d0fb-4676-b4db-42ce7d61d8e8 tempest-VolumesGetTest-1204405293 None] Acquiring lock "cinder-2935c402-f063-4f40-9799-e2183b86d987-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-be7f535a-d0fb-4676-b4db-42ce7d61d8e8 tempest-VolumesGetTest-1204405293 None] Lock "cinder-2935c402-f063-4f40-9799-e2183b86d987-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-be7f535a-d0fb-4676-b4db-42ce7d61d8e8 tempest-VolumesGetTest-1204405293 None] Acquiring lock "cinder-quobyte-2935c402-f063-4f40-9799-e2183b86d987" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:14:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-be7f535a-d0fb-4676-b4db-42ce7d61d8e8 tempest-VolumesGetTest-1204405293 None] Lock "cinder-quobyte-2935c402-f063-4f40-9799-e2183b86d987" acquired by "delete_volume" :: waited 0.048s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:14:59 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7c4dcc-819d-49e9-9e11-441a69e13b13]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:14:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-be7f535a-d0fb-4676-b4db-42ce7d61d8e8 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2935c402-f063-4f40-9799-e2183b86d987 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:14:59 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2935c402-f063-4f40-9799-e2183b86d987 Sep 28 18:14:59 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:00 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-be7f535a-d0fb-4676-b4db-42ce7d61d8e8 tempest-VolumesGetTest-1204405293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2935c402-f063-4f40-9799-e2183b86d987" returned: 0 in 1.028s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-be7f535a-d0fb-4676-b4db-42ce7d61d8e8 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2935c402-f063-4f40-9799-e2183b86d987 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:00 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2935c402-f063-4f40-9799-e2183b86d987 Sep 28 18:15:00 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:01 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-be7f535a-d0fb-4676-b4db-42ce7d61d8e8 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2935c402-f063-4f40-9799-e2183b86d987" returned: 0 in 0.361s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-be7f535a-d0fb-4676-b4db-42ce7d61d8e8 tempest-VolumesGetTest-1204405293 None] Lock "cinder-quobyte-2935c402-f063-4f40-9799-e2183b86d987" released by "delete_volume" :: held 1.513s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:01 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-be7f535a-d0fb-4676-b4db-42ce7d61d8e8 tempest-VolumesGetTest-1204405293 None] Created reservations ['5bcb4e2a-d0d4-4222-8a2a-95912dc6c699', '69ba7a87-b242-43e7-8e36-3e45c9021b50', '5f4612aa-cae3-4432-a71e-dcd3b7dd92c9', '33456096-0431-4f09-99a5-34e5fa6ebe99'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:15:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-be7f535a-d0fb-4676-b4db-42ce7d61d8e8 tempest-VolumesGetTest-1204405293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-be7f535a-d0fb-4676-b4db-42ce7d61d8e8 tempest-VolumesGetTest-1204405293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-be7f535a-d0fb-4676-b4db-42ce7d61d8e8 tempest-VolumesGetTest-1204405293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-be7f535a-d0fb-4676-b4db-42ce7d61d8e8 tempest-VolumesGetTest-1204405293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-be7f535a-d0fb-4676-b4db-42ce7d61d8e8 tempest-VolumesGetTest-1204405293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-be7f535a-d0fb-4676-b4db-42ce7d61d8e8 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:01 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:15:01 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:02 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-872fd70a-c9b4-4966-8ec4-072406b3d81c tempest-VolumesGetTest-1204405293 None] Acquiring lock "cinder-13b4a82d-20dd-43aa-b2d1-60376157a75b-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:02 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-872fd70a-c9b4-4966-8ec4-072406b3d81c tempest-VolumesGetTest-1204405293 None] Lock "cinder-13b4a82d-20dd-43aa-b2d1-60376157a75b-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:02 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-be7f535a-d0fb-4676-b4db-42ce7d61d8e8 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.705s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:02 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-be7f535a-d0fb-4676-b4db-42ce7d61d8e8 tempest-VolumesGetTest-1204405293 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:15:02 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-be7f535a-d0fb-4676-b4db-42ce7d61d8e8 tempest-VolumesGetTest-1204405293 None] Deleted volume successfully. Sep 28 18:15:02 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-872fd70a-c9b4-4966-8ec4-072406b3d81c tempest-VolumesGetTest-1204405293 None] Acquiring lock "cinder-quobyte-13b4a82d-20dd-43aa-b2d1-60376157a75b" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:02 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-be7f535a-d0fb-4676-b4db-42ce7d61d8e8 tempest-VolumesGetTest-1204405293 None] Lock "cinder-2935c402-f063-4f40-9799-e2183b86d987-delete_volume" released by "delete_volume" :: held 2.860s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:02 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-872fd70a-c9b4-4966-8ec4-072406b3d81c tempest-VolumesGetTest-1204405293 None] Lock "cinder-quobyte-13b4a82d-20dd-43aa-b2d1-60376157a75b" acquired by "delete_volume" :: waited 0.038s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:02 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a20c4c1-614f-4bbc-b8d1-d968ad9f6d00]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-872fd70a-c9b4-4966-8ec4-072406b3d81c tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-13b4a82d-20dd-43aa-b2d1-60376157a75b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:02 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-13b4a82d-20dd-43aa-b2d1-60376157a75b Sep 28 18:15:02 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:02 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-d59ee59a-d44b-4460-83e3-0a165b39a859 req-f4d273fd-fc69-4794-805f-3fa3b4e48b7e tempest-AttachVolumeNegativeTest-1060566598 None] Terminate volume connection completed successfully. Sep 28 18:15:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-d59ee59a-d44b-4460-83e3-0a165b39a859 req-f4d273fd-fc69-4794-805f-3fa3b4e48b7e tempest-AttachVolumeNegativeTest-1060566598 None] Deleting attachment d92f80f1-4d4f-49cc-a55c-646ccc12e768. {{(pid=86980) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:15:03 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-872fd70a-c9b4-4966-8ec4-072406b3d81c tempest-VolumesGetTest-1204405293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-13b4a82d-20dd-43aa-b2d1-60376157a75b" returned: 0 in 0.837s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-872fd70a-c9b4-4966-8ec4-072406b3d81c tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-13b4a82d-20dd-43aa-b2d1-60376157a75b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:03 devstack sudo[99182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-13b4a82d-20dd-43aa-b2d1-60376157a75b Sep 28 18:15:03 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:03 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-872fd70a-c9b4-4966-8ec4-072406b3d81c tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-13b4a82d-20dd-43aa-b2d1-60376157a75b" returned: 0 in 0.486s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:03 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-872fd70a-c9b4-4966-8ec4-072406b3d81c tempest-VolumesGetTest-1204405293 None] Lock "cinder-quobyte-13b4a82d-20dd-43aa-b2d1-60376157a75b" released by "delete_volume" :: held 1.405s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:03 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-872fd70a-c9b4-4966-8ec4-072406b3d81c tempest-VolumesGetTest-1204405293 None] Created reservations ['1a2cdd6a-7e8e-4fc1-9a5c-3e287ed7abc8', 'a905fd5e-0b55-4252-b2bf-019a814d3b86', '6b5aa6a9-8c6f-430b-9528-57da20025933', 'f0e9a231-52ec-42cd-bbe2-231fb8d482d3'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:15:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-872fd70a-c9b4-4966-8ec4-072406b3d81c tempest-VolumesGetTest-1204405293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-872fd70a-c9b4-4966-8ec4-072406b3d81c tempest-VolumesGetTest-1204405293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-872fd70a-c9b4-4966-8ec4-072406b3d81c tempest-VolumesGetTest-1204405293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-872fd70a-c9b4-4966-8ec4-072406b3d81c tempest-VolumesGetTest-1204405293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-872fd70a-c9b4-4966-8ec4-072406b3d81c tempest-VolumesGetTest-1204405293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-872fd70a-c9b4-4966-8ec4-072406b3d81c tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:03 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:15:03 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:04 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-872fd70a-c9b4-4966-8ec4-072406b3d81c tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.466s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:04 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-872fd70a-c9b4-4966-8ec4-072406b3d81c tempest-VolumesGetTest-1204405293 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:15:04 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-872fd70a-c9b4-4966-8ec4-072406b3d81c tempest-VolumesGetTest-1204405293 None] Deleted volume successfully. Sep 28 18:15:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-872fd70a-c9b4-4966-8ec4-072406b3d81c tempest-VolumesGetTest-1204405293 None] Lock "cinder-13b4a82d-20dd-43aa-b2d1-60376157a75b-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:15:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:04 devstack sudo[99194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:15:04 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:05 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.814s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:05 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:15:05 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager._thread_info {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:15:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread count: 28 {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:15:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread info: [<_MainThread(MainThread, started 129097393381504)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:15:05 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:15:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Flow 'volume_create_manager' (286e7b3e-9ba3-4110-8822-53734afc3a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4b1f10-2020-4e51-a44f-e5858a0052ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4b1f10-2020-4e51-a44f-e5858a0052ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-253546888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec72d2d-5b72-4960-9684-6bd372aca326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3acbf75f6a084113bb27c4f95674b305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:06Z,use_quota=True,user_id='394b2daed20c40368659402b44a6a650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c50dd6-b68d-4632-8c48-3e17760155dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c50dd6-b68d-4632-8c48-3e17760155dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12353ab4-e606-4ed0-a043-aa0fcbf198a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12353ab4-e606-4ed0-a043-aa0fcbf198a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bec72d2d-5b72-4960-9684-6bd372aca326', 'volume_name': 'volume-bec72d2d-5b72-4960-9684-6bd372aca326', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451acd50-4916-4ab9-8297-e58f1267de9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451acd50-4916-4ab9-8297-e58f1267de9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29dfba7e-19ad-4a90-84a6-944f2cfbfdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:06 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Volume bec72d2d-5b72-4960-9684-6bd372aca326: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bec72d2d-5b72-4960-9684-6bd372aca326', 'volume_size': 1} Sep 28 18:15:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-253546888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec72d2d-5b72-4960-9684-6bd372aca326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3acbf75f6a084113bb27c4f95674b305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:06Z,use_quota=True,user_id='394b2daed20c40368659402b44a6a650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:15:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Creating volume bec72d2d-5b72-4960-9684-6bd372aca326 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:15:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:15:06 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:15:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:06 devstack sudo[99233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326 1073741824 Sep 28 18:15:06 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:06 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326 1073741824" returned: 0 in 0.714s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:06 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326 Sep 28 18:15:06 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:07 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326" returned: 0 in 0.422s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:15:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29dfba7e-19ad-4a90-84a6-944f2cfbfdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bec72d2d-5b72-4960-9684-6bd372aca326', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc0522f-e4be-4714-ab9a-094ed8ce8116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:07 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Volume volume-bec72d2d-5b72-4960-9684-6bd372aca326 (bec72d2d-5b72-4960-9684-6bd372aca326): created successfully Sep 28 18:15:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc0522f-e4be-4714-ab9a-094ed8ce8116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Flow 'volume_create_manager' (286e7b3e-9ba3-4110-8822-53734afc3a9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:07 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-073c65fc-a4aa-4748-8d21-100bce869a89 tempest-VolumesGetTest-1204405293 None] Created volume successfully. Sep 28 18:15:09 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:15:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Flow 'volume_create_manager' (97d66169-62ef-4764-804f-72a6567fb7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61534dc-48d0-45ac-8bce-e6e1fb9ee6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61534dc-48d0-45ac-8bce-e6e1fb9ee6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1098744254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c718a3-0c2d-4642-8daf-84a6c11aa5e9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3acbf75f6a084113bb27c4f95674b305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=bec72d2d-5b72-4960-9684-6bd372aca326,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:09Z,use_quota=True,user_id='394b2daed20c40368659402b44a6a650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f62c5a-3899-4a9a-8b02-2c6815f6dbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f62c5a-3899-4a9a-8b02-2c6815f6dbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a224bb-2b06-42ec-8df1-6426639a8139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a224bb-2b06-42ec-8df1-6426639a8139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c0c718a3-0c2d-4642-8daf-84a6c11aa5e9', 'volume_name': 'volume-c0c718a3-0c2d-4642-8daf-84a6c11aa5e9', 'volume_size': 1, 'source_volid': 'bec72d2d-5b72-4960-9684-6bd372aca326', 'source_volstatus': 'available'}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6859d46-fe4d-4df6-befc-d7351d6cb206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6859d46-fe4d-4df6-befc-d7351d6cb206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc49a70-0990-4852-9b86-0fbd7327dfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:09 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Volume c0c718a3-0c2d-4642-8daf-84a6c11aa5e9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c0c718a3-0c2d-4642-8daf-84a6c11aa5e9', 'volume_size': 1, 'source_volid': 'bec72d2d-5b72-4960-9684-6bd372aca326', 'source_volstatus': 'available'} Sep 28 18:15:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:09 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Cloning volume bec72d2d-5b72-4960-9684-6bd372aca326 to volume c0c718a3-0c2d-4642-8daf-84a6c11aa5e9 Sep 28 18:15:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Creating offline snapshot 50ad6c1f-ae4e-46bb-ae7b-97ef31f0103e of volume bec72d2d-5b72-4960-9684-6bd372aca326 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:15:09 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[db980cce-cfb5-4af3-bf11-1f8fe01f19f7]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:09 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326 Sep 28 18:15:09 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:10 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326" returned: 0 in 0.608s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326.50ad6c1f-ae4e-46bb-ae7b-97ef31f0103e 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:10 devstack sudo[99249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326.50ad6c1f-ae4e-46bb-ae7b-97ef31f0103e 1G Sep 28 18:15:10 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:10 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326.50ad6c1f-ae4e-46bb-ae7b-97ef31f0103e 1G" returned: 0 in 0.613s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bec72d2d-5b72-4960-9684-6bd372aca326 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326.50ad6c1f-ae4e-46bb-ae7b-97ef31f0103e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:10 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bec72d2d-5b72-4960-9684-6bd372aca326 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326.50ad6c1f-ae4e-46bb-ae7b-97ef31f0103e Sep 28 18:15:10 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:11 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bec72d2d-5b72-4960-9684-6bd372aca326 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326.50ad6c1f-ae4e-46bb-ae7b-97ef31f0103e" returned: 0 in 0.480s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:11 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326.50ad6c1f-ae4e-46bb-ae7b-97ef31f0103e is being set with open permissions: ugo+rw Sep 28 18:15:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326.50ad6c1f-ae4e-46bb-ae7b-97ef31f0103e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:11 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326.50ad6c1f-ae4e-46bb-ae7b-97ef31f0103e Sep 28 18:15:11 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:11 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326.50ad6c1f-ae4e-46bb-ae7b-97ef31f0103e" returned: 0 in 0.362s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:11 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326.info Sep 28 18:15:11 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:11 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326.info" returned: 0 in 0.363s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:11 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326.info is being set with open permissions: ugo+rw Sep 28 18:15:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:11 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326.info Sep 28 18:15:11 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:12 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326.info" returned: 0 in 0.382s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:12 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Acquiring lock "cinder-quobyte-c0c718a3-0c2d-4642-8daf-84a6c11aa5e9" by "_copy_volume_from_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:12 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Lock "cinder-quobyte-c0c718a3-0c2d-4642-8daf-84a6c11aa5e9" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:12 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] snapshot: 50ad6c1f-ae4e-46bb-ae7b-97ef31f0103e, volume: c0c718a3-0c2d-4642-8daf-84a6c11aa5e9, {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:15:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:12 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:12 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:12 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0b3ce1-a6c4-4135-a1ba-72ff47320a50]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326.50ad6c1f-ae4e-46bb-ae7b-97ef31f0103e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:12 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326.50ad6c1f-ae4e-46bb-ae7b-97ef31f0103e Sep 28 18:15:12 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:12 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326.50ad6c1f-ae4e-46bb-ae7b-97ef31f0103e" returned: 0 in 0.538s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:12 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bec72d2d-5b72-4960-9684-6bd372aca326(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:15:12 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b537dcb7-a0dc-407c-96f4-a4c3ed10348b]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:13 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326 Sep 28 18:15:13 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:13 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326" returned: 0 in 0.731s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:13 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326 {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:15:13 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Creating direct copy from snapshot {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:15:13 devstack cinder-volume[86980]: DEBUG cinder.utils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Path /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0c718a3-0c2d-4642-8daf-84a6c11aa5e9 not found in is_blk_device check {{(pid=86980) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:15:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0c718a3-0c2d-4642-8daf-84a6c11aa5e9 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:13 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0c718a3-0c2d-4642-8daf-84a6c11aa5e9 Sep 28 18:15:13 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-489a46e2-cffd-43f4-8aeb-04f2cbf05b42 req-ff61e11e-699b-4cb2-a223-26328a3872db tempest-TestInstancesWithCinderVolumes-359587429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:24 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0c718a3-0c2d-4642-8daf-84a6c11aa5e9" returned: 0 in 10.987s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:24 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Image conversion details: src /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326, size 1024.00 MB, duration 10.99 sec, destination /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0c718a3-0c2d-4642-8daf-84a6c11aa5e9 {{(pid=86980) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:15:24 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Converted 1024.00 MB image at 93.19 MB/s Sep 28 18:15:24 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0c718a3-0c2d-4642-8daf-84a6c11aa5e9 is being set with open permissions: ugo+rw Sep 28 18:15:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0c718a3-0c2d-4642-8daf-84a6c11aa5e9 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:24 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0c718a3-0c2d-4642-8daf-84a6c11aa5e9 Sep 28 18:15:24 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:25 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0c718a3-0c2d-4642-8daf-84a6c11aa5e9" returned: 0 in 0.455s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:25 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Lock "cinder-quobyte-c0c718a3-0c2d-4642-8daf-84a6c11aa5e9" released by "_copy_volume_from_snapshot" :: held 12.856s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:25 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Acquiring lock "cinder-quobyte-50ad6c1f-ae4e-46bb-ae7b-97ef31f0103e" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:25 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Lock "cinder-quobyte-50ad6c1f-ae4e-46bb-ae7b-97ef31f0103e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:25 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Deleting offline snapshot 50ad6c1f-ae4e-46bb-ae7b-97ef31f0103e of volume bec72d2d-5b72-4960-9684-6bd372aca326 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:15:25 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] snapshot_file for this snap is: volume-bec72d2d-5b72-4960-9684-6bd372aca326.50ad6c1f-ae4e-46bb-ae7b-97ef31f0103e {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:15:25 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f0d0b1-3ea8-4a37-8661-8553f7e8af21]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326.50ad6c1f-ae4e-46bb-ae7b-97ef31f0103e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:25 devstack sudo[99342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326.50ad6c1f-ae4e-46bb-ae7b-97ef31f0103e Sep 28 18:15:25 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:25 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326.50ad6c1f-ae4e-46bb-ae7b-97ef31f0103e" returned: 0 in 0.635s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:25 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bec72d2d-5b72-4960-9684-6bd372aca326(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:15:26 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcdaf66-de1b-4dc3-9ca7-c36341495ab2]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:26 devstack sudo[99347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326 Sep 28 18:15:26 devstack sudo[99347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:27 devstack sudo[99347]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326" returned: 0 in 1.088s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326.50ad6c1f-ae4e-46bb-ae7b-97ef31f0103e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:27 devstack sudo[99360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326.50ad6c1f-ae4e-46bb-ae7b-97ef31f0103e Sep 28 18:15:27 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326.50ad6c1f-ae4e-46bb-ae7b-97ef31f0103e" returned: 0 in 0.724s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326.50ad6c1f-ae4e-46bb-ae7b-97ef31f0103e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:27 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:27 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326.50ad6c1f-ae4e-46bb-ae7b-97ef31f0103e Sep 28 18:15:27 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:28 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326.50ad6c1f-ae4e-46bb-ae7b-97ef31f0103e" returned: 0 in 0.484s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:28 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Lock "cinder-quobyte-50ad6c1f-ae4e-46bb-ae7b-97ef31f0103e" released by "_delete_snapshot" :: held 3.184s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.199s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-489a46e2-cffd-43f4-8aeb-04f2cbf05b42 req-ff61e11e-699b-4cb2-a223-26328a3872db tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.352s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc49a70-0990-4852-9b86-0fbd7327dfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0c718a3-0c2d-4642-8daf-84a6c11aa5e9', 'volume_size': 1, 'source_volid': 'bec72d2d-5b72-4960-9684-6bd372aca326', 'source_volstatus': 'available'}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d04c092-0310-4e87-8899-d0b350b5a593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-489a46e2-cffd-43f4-8aeb-04f2cbf05b42 req-ff61e11e-699b-4cb2-a223-26328a3872db tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:28 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Volume volume-c0c718a3-0c2d-4642-8daf-84a6c11aa5e9 (c0c718a3-0c2d-4642-8daf-84a6c11aa5e9): created successfully Sep 28 18:15:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d04c092-0310-4e87-8899-d0b350b5a593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Flow 'volume_create_manager' (97d66169-62ef-4764-804f-72a6567fb7f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-489a46e2-cffd-43f4-8aeb-04f2cbf05b42 req-ff61e11e-699b-4cb2-a223-26328a3872db tempest-TestInstancesWithCinderVolumes-359587429 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729', 'name': 'volume-a30fec9c-c578-4cbf-a289-b97bd650c139', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e6eaec73-ea97-4bc8-ba85-c834d87d463b', 'enforce_multipath': True} {{(pid=86980) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:15:28 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-cc4f96b5-86fd-4fa0-ab10-ad59f2e46fb0 tempest-VolumesGetTest-1204405293 None] Created volume successfully. Sep 28 18:15:28 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-489a46e2-cffd-43f4-8aeb-04f2cbf05b42 req-ff61e11e-699b-4cb2-a223-26328a3872db tempest-TestInstancesWithCinderVolumes-359587429 None] attachment_update completed successfully. Sep 28 18:15:31 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:15:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Flow 'volume_create_manager' (2cc640cc-e44f-4da3-ba24-1dc040284f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe3f9b55-013c-4527-9b3d-4176f33f1fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe3f9b55-013c-4527-9b3d-4176f33f1fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-413452671',display_name='tempest-VolumesGetTest-Volume-2120522642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee76a4a7-4f04-489b-9b9d-5771a6416d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3acbf75f6a084113bb27c4f95674b305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:31Z,use_quota=True,user_id='394b2daed20c40368659402b44a6a650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c654c8a-4240-4f95-94db-32880046f702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c654c8a-4240-4f95-94db-32880046f702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f960fdd8-2ef9-4017-a1ba-e38516a9f87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f960fdd8-2ef9-4017-a1ba-e38516a9f87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee76a4a7-4f04-489b-9b9d-5771a6416d23', 'volume_name': 'volume-ee76a4a7-4f04-489b-9b9d-5771a6416d23', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74626772-3cbf-4c0a-93c1-2111b0969e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74626772-3cbf-4c0a-93c1-2111b0969e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70195b7e-443c-4503-bfbe-512a153a5e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:31 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Volume ee76a4a7-4f04-489b-9b9d-5771a6416d23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee76a4a7-4f04-489b-9b9d-5771a6416d23', 'volume_size': 1} Sep 28 18:15:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:31 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-413452671',display_name='tempest-VolumesGetTest-Volume-2120522642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee76a4a7-4f04-489b-9b9d-5771a6416d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3acbf75f6a084113bb27c4f95674b305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:31Z,use_quota=True,user_id='394b2daed20c40368659402b44a6a650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:15:31 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Creating volume ee76a4a7-4f04-489b-9b9d-5771a6416d23 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:15:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:31 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:31 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:31 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:15:31 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:15:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ee76a4a7-4f04-489b-9b9d-5771a6416d23 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:31 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ee76a4a7-4f04-489b-9b9d-5771a6416d23 1073741824 Sep 28 18:15:31 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:32 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ee76a4a7-4f04-489b-9b9d-5771a6416d23 1073741824" returned: 0 in 1.320s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ee76a4a7-4f04-489b-9b9d-5771a6416d23 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:32 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ee76a4a7-4f04-489b-9b9d-5771a6416d23 Sep 28 18:15:32 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:33 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ee76a4a7-4f04-489b-9b9d-5771a6416d23" returned: 0 in 0.807s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] <== create_volume: return (2324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:15:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.328s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:33 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=57,cinder:UPDATE=56,cinder:INSERT=12,cinder:DELETE=5 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:15:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70195b7e-443c-4503-bfbe-512a153a5e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee76a4a7-4f04-489b-9b9d-5771a6416d23', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a605418-3a68-4131-bc04-9255b67ecb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:33 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=46,cinder:UPDATE=45,cinder:INSERT=9,cinder:DELETE=4 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:15:33 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Volume volume-ee76a4a7-4f04-489b-9b9d-5771a6416d23 (ee76a4a7-4f04-489b-9b9d-5771a6416d23): created successfully Sep 28 18:15:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a605418-3a68-4131-bc04-9255b67ecb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Flow 'volume_create_manager' (2cc640cc-e44f-4da3-ba24-1dc040284f21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:33 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-bf3fe448-d430-42c3-8e83-086520a792c3 tempest-VolumesGetTest-1204405293 None] Created volume successfully. Sep 28 18:15:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-82199b75-4d3e-4f83-989d-5d0ecb9e1b94 req-68076995-093a-4eed-852f-f396b5d142ed tempest-TestInstancesWithCinderVolumes-359587429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-82199b75-4d3e-4f83-989d-5d0ecb9e1b94 req-68076995-093a-4eed-852f-f396b5d142ed tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-82199b75-4d3e-4f83-989d-5d0ecb9e1b94 req-68076995-093a-4eed-852f-f396b5d142ed tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:34 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-82199b75-4d3e-4f83-989d-5d0ecb9e1b94 req-68076995-093a-4eed-852f-f396b5d142ed tempest-TestInstancesWithCinderVolumes-359587429 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729', 'name': 'volume-f6776b57-536f-4121-9477-656e635367c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1777d8c-45b2-47e6-b6ce-b8a33d8eb1d4', 'enforce_multipath': True} {{(pid=86980) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:15:34 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4520ed41-e9a3-4408-acea-9f477e59d4d2 tempest-VolumesGetTest-1204405293 None] Acquiring lock "cinder-ee76a4a7-4f04-489b-9b9d-5771a6416d23-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:35 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4520ed41-e9a3-4408-acea-9f477e59d4d2 tempest-VolumesGetTest-1204405293 None] Lock "cinder-ee76a4a7-4f04-489b-9b9d-5771a6416d23-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:35 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-82199b75-4d3e-4f83-989d-5d0ecb9e1b94 req-68076995-093a-4eed-852f-f396b5d142ed tempest-TestInstancesWithCinderVolumes-359587429 None] attachment_update completed successfully. Sep 28 18:15:35 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4520ed41-e9a3-4408-acea-9f477e59d4d2 tempest-VolumesGetTest-1204405293 None] Acquiring lock "cinder-quobyte-ee76a4a7-4f04-489b-9b9d-5771a6416d23" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:35 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4520ed41-e9a3-4408-acea-9f477e59d4d2 tempest-VolumesGetTest-1204405293 None] Lock "cinder-quobyte-ee76a4a7-4f04-489b-9b9d-5771a6416d23" acquired by "delete_volume" :: waited 0.049s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:35 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead9e6b3-4a8d-4385-9f45-997d3663c1d0]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4520ed41-e9a3-4408-acea-9f477e59d4d2 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ee76a4a7-4f04-489b-9b9d-5771a6416d23 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:35 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ee76a4a7-4f04-489b-9b9d-5771a6416d23 Sep 28 18:15:35 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:36 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4520ed41-e9a3-4408-acea-9f477e59d4d2 tempest-VolumesGetTest-1204405293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ee76a4a7-4f04-489b-9b9d-5771a6416d23" returned: 0 in 1.000s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4520ed41-e9a3-4408-acea-9f477e59d4d2 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ee76a4a7-4f04-489b-9b9d-5771a6416d23 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:36 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ee76a4a7-4f04-489b-9b9d-5771a6416d23 Sep 28 18:15:36 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:37 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4520ed41-e9a3-4408-acea-9f477e59d4d2 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ee76a4a7-4f04-489b-9b9d-5771a6416d23" returned: 0 in 0.836s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:37 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4520ed41-e9a3-4408-acea-9f477e59d4d2 tempest-VolumesGetTest-1204405293 None] Lock "cinder-quobyte-ee76a4a7-4f04-489b-9b9d-5771a6416d23" released by "delete_volume" :: held 2.014s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:37 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-4520ed41-e9a3-4408-acea-9f477e59d4d2 tempest-VolumesGetTest-1204405293 None] Created reservations ['e0e4f137-9386-4b3d-8e1b-4d3bd9172144', 'd5bc3311-ae1e-41b9-9240-409ebbe3f42a', '28989972-60bf-4aca-80fa-bd861e578842', '3b05f6cf-7b86-4ce3-afd6-e5ea6a0ee91b'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:15:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4520ed41-e9a3-4408-acea-9f477e59d4d2 tempest-VolumesGetTest-1204405293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4520ed41-e9a3-4408-acea-9f477e59d4d2 tempest-VolumesGetTest-1204405293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4520ed41-e9a3-4408-acea-9f477e59d4d2 tempest-VolumesGetTest-1204405293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4520ed41-e9a3-4408-acea-9f477e59d4d2 tempest-VolumesGetTest-1204405293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4520ed41-e9a3-4408-acea-9f477e59d4d2 tempest-VolumesGetTest-1204405293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4520ed41-e9a3-4408-acea-9f477e59d4d2 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:37 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:15:37 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:38 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4520ed41-e9a3-4408-acea-9f477e59d4d2 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.407s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:38 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-4520ed41-e9a3-4408-acea-9f477e59d4d2 tempest-VolumesGetTest-1204405293 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:15:38 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-4520ed41-e9a3-4408-acea-9f477e59d4d2 tempest-VolumesGetTest-1204405293 None] Deleted volume successfully. Sep 28 18:15:38 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4520ed41-e9a3-4408-acea-9f477e59d4d2 tempest-VolumesGetTest-1204405293 None] Lock "cinder-ee76a4a7-4f04-489b-9b9d-5771a6416d23-delete_volume" released by "delete_volume" :: held 3.320s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:38 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-54cbe2a1-56e7-4623-840e-d1c8476b5115 tempest-VolumesGetTest-1204405293 None] Acquiring lock "cinder-c0c718a3-0c2d-4642-8daf-84a6c11aa5e9-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:38 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-54cbe2a1-56e7-4623-840e-d1c8476b5115 tempest-VolumesGetTest-1204405293 None] Lock "cinder-c0c718a3-0c2d-4642-8daf-84a6c11aa5e9-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-54cbe2a1-56e7-4623-840e-d1c8476b5115 tempest-VolumesGetTest-1204405293 None] Acquiring lock "cinder-quobyte-c0c718a3-0c2d-4642-8daf-84a6c11aa5e9" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-54cbe2a1-56e7-4623-840e-d1c8476b5115 tempest-VolumesGetTest-1204405293 None] Lock "cinder-quobyte-c0c718a3-0c2d-4642-8daf-84a6c11aa5e9" acquired by "delete_volume" :: waited 0.066s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:39 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15733e0-7dfc-4695-aa39-c8e57885b6ba]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-54cbe2a1-56e7-4623-840e-d1c8476b5115 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0c718a3-0c2d-4642-8daf-84a6c11aa5e9 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:39 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0c718a3-0c2d-4642-8daf-84a6c11aa5e9 Sep 28 18:15:39 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:40 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-54cbe2a1-56e7-4623-840e-d1c8476b5115 tempest-VolumesGetTest-1204405293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0c718a3-0c2d-4642-8daf-84a6c11aa5e9" returned: 0 in 0.747s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-54cbe2a1-56e7-4623-840e-d1c8476b5115 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0c718a3-0c2d-4642-8daf-84a6c11aa5e9 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:40 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0c718a3-0c2d-4642-8daf-84a6c11aa5e9 Sep 28 18:15:40 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:40 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-54cbe2a1-56e7-4623-840e-d1c8476b5115 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0c718a3-0c2d-4642-8daf-84a6c11aa5e9" returned: 0 in 0.656s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-54cbe2a1-56e7-4623-840e-d1c8476b5115 tempest-VolumesGetTest-1204405293 None] Lock "cinder-quobyte-c0c718a3-0c2d-4642-8daf-84a6c11aa5e9" released by "delete_volume" :: held 1.558s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:40 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-54cbe2a1-56e7-4623-840e-d1c8476b5115 tempest-VolumesGetTest-1204405293 None] Created reservations ['f0df6098-559d-4ea8-b51d-d6551ea4c03d', '5f7d1106-a70f-46a9-8c9b-4d8d97ac1eaa', 'd06acdb4-3745-4a06-94e0-dd595cc4985f', '479e0f9e-b2cb-478d-819e-3ded34028226'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:15:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-54cbe2a1-56e7-4623-840e-d1c8476b5115 tempest-VolumesGetTest-1204405293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-54cbe2a1-56e7-4623-840e-d1c8476b5115 tempest-VolumesGetTest-1204405293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:40 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-54cbe2a1-56e7-4623-840e-d1c8476b5115 tempest-VolumesGetTest-1204405293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:41 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-54cbe2a1-56e7-4623-840e-d1c8476b5115 tempest-VolumesGetTest-1204405293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-54cbe2a1-56e7-4623-840e-d1c8476b5115 tempest-VolumesGetTest-1204405293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-54cbe2a1-56e7-4623-840e-d1c8476b5115 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:41 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:15:41 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-801cff5f-49f0-4ca8-9cff-4530f85fae69 tempest-VolumesGetTest-1204405293 None] Acquiring lock "cinder-bec72d2d-5b72-4960-9684-6bd372aca326-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-801cff5f-49f0-4ca8-9cff-4530f85fae69 tempest-VolumesGetTest-1204405293 None] Lock "cinder-bec72d2d-5b72-4960-9684-6bd372aca326-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-801cff5f-49f0-4ca8-9cff-4530f85fae69 tempest-VolumesGetTest-1204405293 None] Acquiring lock "cinder-quobyte-bec72d2d-5b72-4960-9684-6bd372aca326" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:41 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-54cbe2a1-56e7-4623-840e-d1c8476b5115 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.952s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:41 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-54cbe2a1-56e7-4623-840e-d1c8476b5115 tempest-VolumesGetTest-1204405293 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:15:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-801cff5f-49f0-4ca8-9cff-4530f85fae69 tempest-VolumesGetTest-1204405293 None] Lock "cinder-quobyte-bec72d2d-5b72-4960-9684-6bd372aca326" acquired by "delete_volume" :: waited 0.061s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:42 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-54cbe2a1-56e7-4623-840e-d1c8476b5115 tempest-VolumesGetTest-1204405293 None] Deleted volume successfully. Sep 28 18:15:42 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc44d20-603d-4f45-b5a8-24ebda175f03]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-801cff5f-49f0-4ca8-9cff-4530f85fae69 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-54cbe2a1-56e7-4623-840e-d1c8476b5115 tempest-VolumesGetTest-1204405293 None] Lock "cinder-c0c718a3-0c2d-4642-8daf-84a6c11aa5e9-delete_volume" released by "delete_volume" :: held 3.216s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:42 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326 Sep 28 18:15:42 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:42 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-801cff5f-49f0-4ca8-9cff-4530f85fae69 tempest-VolumesGetTest-1204405293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326" returned: 0 in 0.827s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-801cff5f-49f0-4ca8-9cff-4530f85fae69 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:43 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326 Sep 28 18:15:43 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:43 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-801cff5f-49f0-4ca8-9cff-4530f85fae69 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bec72d2d-5b72-4960-9684-6bd372aca326" returned: 0 in 0.456s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-801cff5f-49f0-4ca8-9cff-4530f85fae69 tempest-VolumesGetTest-1204405293 None] Lock "cinder-quobyte-bec72d2d-5b72-4960-9684-6bd372aca326" released by "delete_volume" :: held 1.462s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:43 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-801cff5f-49f0-4ca8-9cff-4530f85fae69 tempest-VolumesGetTest-1204405293 None] Created reservations ['6be25d43-0136-4710-ba59-b63751605fd2', '1b69e7e8-9796-4826-a43b-d3b5adc05632', '5ebd07e5-e747-4214-a6a0-9653bea9be3f', 'd9cedee0-d595-4833-b04d-12190dbf3cf3'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:15:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-801cff5f-49f0-4ca8-9cff-4530f85fae69 tempest-VolumesGetTest-1204405293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-801cff5f-49f0-4ca8-9cff-4530f85fae69 tempest-VolumesGetTest-1204405293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-801cff5f-49f0-4ca8-9cff-4530f85fae69 tempest-VolumesGetTest-1204405293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-801cff5f-49f0-4ca8-9cff-4530f85fae69 tempest-VolumesGetTest-1204405293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-801cff5f-49f0-4ca8-9cff-4530f85fae69 tempest-VolumesGetTest-1204405293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-801cff5f-49f0-4ca8-9cff-4530f85fae69 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:43 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:15:43 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:44 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-801cff5f-49f0-4ca8-9cff-4530f85fae69 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.292s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:44 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-801cff5f-49f0-4ca8-9cff-4530f85fae69 tempest-VolumesGetTest-1204405293 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:15:44 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-801cff5f-49f0-4ca8-9cff-4530f85fae69 tempest-VolumesGetTest-1204405293 None] Deleted volume successfully. Sep 28 18:15:44 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-801cff5f-49f0-4ca8-9cff-4530f85fae69 tempest-VolumesGetTest-1204405293 None] Lock "cinder-bec72d2d-5b72-4960-9684-6bd372aca326-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:45 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:15:45 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Flow 'volume_create_manager' (562d8a5f-dc79-4771-a491-4050ffd9a1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:45 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0fc2f8c-bb8d-44e9-ae16-cde767b28bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:45 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0fc2f8c-bb8d-44e9-ae16-cde767b28bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-832022701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b728e14-0a06-4902-9d8c-23efd5612701,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3acbf75f6a084113bb27c4f95674b305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:45Z,use_quota=True,user_id='394b2daed20c40368659402b44a6a650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:45 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e59f03a6-bf2d-46b9-9419-dddd4e173ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:45 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e59f03a6-bf2d-46b9-9419-dddd4e173ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:45 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d92fd5-6033-45e1-9606-a4941ee47c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:45 devstack cinder-volume[86980]: DEBUG cinder.image.glance [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Creating Keystone auth plugin from conf {{(pid=86980) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:15:45 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-40aff73e-c67e-4a7f-9d07-f30b7ec6b11c req-ae3d8e7f-c078-4c0c-9183-d186de31b651 tempest-TestInstancesWithCinderVolumes-359587429 None] Terminate volume connection completed successfully. Sep 28 18:15:45 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-40aff73e-c67e-4a7f-9d07-f30b7ec6b11c req-ae3d8e7f-c078-4c0c-9183-d186de31b651 tempest-TestInstancesWithCinderVolumes-359587429 None] Deleting attachment e6eaec73-ea97-4bc8-ba85-c834d87d463b. {{(pid=86980) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:15:46 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d92fd5-6033-45e1-9606-a4941ee47c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6b728e14-0a06-4902-9d8c-23efd5612701', 'volume_name': 'volume-6b728e14-0a06-4902-9d8c-23efd5612701', 'volume_size': 1, 'image_id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c13a4cea8f714bb0b9012709acb9372b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'created_at': datetime.datetime(2026, 9, 28, 15, 57, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 57, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:46 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5b4eb3-308f-4da6-a799-7679f69839c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:46 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5b4eb3-308f-4da6-a799-7679f69839c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:46 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ccaef21-d789-40be-bf2f-ba153ec82634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:46 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Volume 6b728e14-0a06-4902-9d8c-23efd5612701: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6b728e14-0a06-4902-9d8c-23efd5612701', 'volume_size': 1, 'image_id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c13a4cea8f714bb0b9012709acb9372b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'created_at': datetime.datetime(2026, 9, 28, 15, 57, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 57, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 18:15:46 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Trying to clone 6b728e14-0a06-4902-9d8c-23efd5612701 from image d5838d4d-ebb7-4d18-8c3c-fc660c294083 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}]). {{(pid=86980) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:15:46 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ab034753-78e2-4337-88f7-363a19cc5a97 tempest-TestInstancesWithCinderVolumes-359587429 None] Acquiring lock "cinder-a30fec9c-c578-4cbf-a289-b97bd650c139-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:46 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ab034753-78e2-4337-88f7-363a19cc5a97 tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "cinder-a30fec9c-c578-4cbf-a289-b97bd650c139-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:46 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ab034753-78e2-4337-88f7-363a19cc5a97 tempest-TestInstancesWithCinderVolumes-359587429 None] Acquiring lock "cinder-quobyte-a30fec9c-c578-4cbf-a289-b97bd650c139" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:46 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ab034753-78e2-4337-88f7-363a19cc5a97 tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "cinder-quobyte-a30fec9c-c578-4cbf-a289-b97bd650c139" acquired by "delete_volume" :: waited 0.074s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:46 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d18095-b14c-4ca2-9f97-2345e5bce29e]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ab034753-78e2-4337-88f7-363a19cc5a97 tempest-TestInstancesWithCinderVolumes-359587429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a30fec9c-c578-4cbf-a289-b97bd650c139 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:46 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ttaix1sjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:15:46 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Image download 20.69 MB at 20.69 MB/s Sep 28 18:15:46 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ecc6ca-bed0-432f-a5cd-6ca1acc4ce8b]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ttaix1sjdevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:47 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a30fec9c-c578-4cbf-a289-b97bd650c139 Sep 28 18:15:47 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:47 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ttaix1sjdevstack@QuobyteHD Sep 28 18:15:47 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:47 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ab034753-78e2-4337-88f7-363a19cc5a97 tempest-TestInstancesWithCinderVolumes-359587429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a30fec9c-c578-4cbf-a289-b97bd650c139" returned: 0 in 0.703s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ab034753-78e2-4337-88f7-363a19cc5a97 tempest-TestInstancesWithCinderVolumes-359587429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a30fec9c-c578-4cbf-a289-b97bd650c139 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:47 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a30fec9c-c578-4cbf-a289-b97bd650c139 Sep 28 18:15:47 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:47 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ttaix1sjdevstack@QuobyteHD" returned: 0 in 0.764s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:47 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Temporary image d5838d4d-ebb7-4d18-8c3c-fc660c294083 is fetched for user 394b2daed20c40368659402b44a6a650. {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:15:47 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[99554f1c-d793-4058-b682-dc3931ee00b7]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ttaix1sjdevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:47 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ab034753-78e2-4337-88f7-363a19cc5a97 tempest-TestInstancesWithCinderVolumes-359587429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a30fec9c-c578-4cbf-a289-b97bd650c139" returned: 0 in 0.496s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ab034753-78e2-4337-88f7-363a19cc5a97 tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "cinder-quobyte-a30fec9c-c578-4cbf-a289-b97bd650c139" released by "delete_volume" :: held 1.335s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:48 devstack cinder-volume[86980]: WARNING cinder.quota [None req-ab034753-78e2-4337-88f7-363a19cc5a97 tempest-TestInstancesWithCinderVolumes-359587429 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1734507622-426773835 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1734507622-426773835, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:15:48 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ttaix1sjdevstack@QuobyteHD Sep 28 18:15:48 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:48 devstack cinder-volume[86980]: WARNING cinder.quota [None req-ab034753-78e2-4337-88f7-363a19cc5a97 tempest-TestInstancesWithCinderVolumes-359587429 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1734507622-426773835 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1734507622-426773835, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:15:48 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-ab034753-78e2-4337-88f7-363a19cc5a97 tempest-TestInstancesWithCinderVolumes-359587429 None] Created reservations ['216ab794-8530-4317-8414-82b89b59a455', '41c879bf-d5b7-42ed-b354-2f702fdaadd3', '1a298db5-47e9-4bcf-be3e-fbaefc30e564', 'dc28cf85-f54c-4bc6-bd59-70e8123bae6d'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:15:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ab034753-78e2-4337-88f7-363a19cc5a97 tempest-TestInstancesWithCinderVolumes-359587429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ab034753-78e2-4337-88f7-363a19cc5a97 tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:48 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ab034753-78e2-4337-88f7-363a19cc5a97 tempest-TestInstancesWithCinderVolumes-359587429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:48 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ab034753-78e2-4337-88f7-363a19cc5a97 tempest-TestInstancesWithCinderVolumes-359587429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ab034753-78e2-4337-88f7-363a19cc5a97 tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ab034753-78e2-4337-88f7-363a19cc5a97 tempest-TestInstancesWithCinderVolumes-359587429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:48 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:15:48 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:48 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ttaix1sjdevstack@QuobyteHD" returned: 0 in 0.657s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:48 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-832022701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b728e14-0a06-4902-9d8c-23efd5612701,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3acbf75f6a084113bb27c4f95674b305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:45Z,use_quota=True,user_id='394b2daed20c40368659402b44a6a650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:15:48 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Creating volume 6b728e14-0a06-4902-9d8c-23efd5612701 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:15:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:48 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:48 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:48 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:15:48 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:15:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6b728e14-0a06-4902-9d8c-23efd5612701 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:48 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6b728e14-0a06-4902-9d8c-23efd5612701 1073741824 Sep 28 18:15:48 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:48 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ab034753-78e2-4337-88f7-363a19cc5a97 tempest-TestInstancesWithCinderVolumes-359587429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.407s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:48 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-ab034753-78e2-4337-88f7-363a19cc5a97 tempest-TestInstancesWithCinderVolumes-359587429 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:15:48 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-ab034753-78e2-4337-88f7-363a19cc5a97 tempest-TestInstancesWithCinderVolumes-359587429 None] Deleted volume successfully. Sep 28 18:15:48 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ab034753-78e2-4337-88f7-363a19cc5a97 tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "cinder-a30fec9c-c578-4cbf-a289-b97bd650c139-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:49 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6b728e14-0a06-4902-9d8c-23efd5612701 1073741824" returned: 0 in 0.635s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6b728e14-0a06-4902-9d8c-23efd5612701 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:49 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6b728e14-0a06-4902-9d8c-23efd5612701 Sep 28 18:15:49 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:49 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6b728e14-0a06-4902-9d8c-23efd5612701" returned: 0 in 0.338s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:15:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:49 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Attempting download of d5838d4d-ebb7-4d18-8c3c-fc660c294083 ((None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}])) to volume 6b728e14-0a06-4902-9d8c-23efd5612701. {{(pid=86980) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:15:49 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2975d1f1-a21e-4e21-b1b8-f8fb073f5568]: (4, 'raw') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_77ikcozg {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:49 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_77ikcozg Sep 28 18:15:49 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:50 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_77ikcozg" returned: 0 in 0.400s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_77ikcozg {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:50 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_77ikcozg Sep 28 18:15:50 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:50 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_77ikcozg" returned: 1 in 0.396s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_77ikcozg' failed. Not Retrying. {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:15:50 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc38940-8560-486b-a7bf-bbb0e40f07fc]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ttaix1sjdevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:50 devstack sudo[99767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ttaix1sjdevstack@QuobyteHD Sep 28 18:15:50 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:50 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ttaix1sjdevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:50 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] d5838d4d-ebb7-4d18-8c3c-fc660c294083 was qcow2, converting to qcow2 {{(pid=86980) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:15:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ttaix1sjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6b728e14-0a06-4902-9d8c-23efd5612701 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:50 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ttaix1sjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6b728e14-0a06-4902-9d8c-23efd5612701 Sep 28 18:15:50 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:52 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-082f1f97-272c-4530-860a-8bcaa3647958 req-0a8c4de0-d85a-4f2c-a4a8-02542d24a809 tempest-TestInstancesWithCinderVolumes-359587429 None] Terminate volume connection completed successfully. Sep 28 18:15:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-082f1f97-272c-4530-860a-8bcaa3647958 req-0a8c4de0-d85a-4f2c-a4a8-02542d24a809 tempest-TestInstancesWithCinderVolumes-359587429 None] Deleting attachment b1777d8c-45b2-47e6-b6ce-b8a33d8eb1d4. {{(pid=86980) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:15:52 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-67313998-2dc7-4c5a-82af-dc3af8a79e14 tempest-TestInstancesWithCinderVolumes-359587429 None] Acquiring lock "cinder-f6776b57-536f-4121-9477-656e635367c8-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:52 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-67313998-2dc7-4c5a-82af-dc3af8a79e14 tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "cinder-f6776b57-536f-4121-9477-656e635367c8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:52 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-67313998-2dc7-4c5a-82af-dc3af8a79e14 tempest-TestInstancesWithCinderVolumes-359587429 None] Acquiring lock "cinder-quobyte-f6776b57-536f-4121-9477-656e635367c8" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:52 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-67313998-2dc7-4c5a-82af-dc3af8a79e14 tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "cinder-quobyte-f6776b57-536f-4121-9477-656e635367c8" acquired by "delete_volume" :: waited 0.019s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:52 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f670bfce-ec10-4eff-9300-0f18212125f7]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-67313998-2dc7-4c5a-82af-dc3af8a79e14 tempest-TestInstancesWithCinderVolumes-359587429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f6776b57-536f-4121-9477-656e635367c8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:52 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f6776b57-536f-4121-9477-656e635367c8 Sep 28 18:15:52 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:53 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-67313998-2dc7-4c5a-82af-dc3af8a79e14 tempest-TestInstancesWithCinderVolumes-359587429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f6776b57-536f-4121-9477-656e635367c8" returned: 0 in 0.617s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-67313998-2dc7-4c5a-82af-dc3af8a79e14 tempest-TestInstancesWithCinderVolumes-359587429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f6776b57-536f-4121-9477-656e635367c8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:53 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f6776b57-536f-4121-9477-656e635367c8 Sep 28 18:15:53 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:53 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ttaix1sjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6b728e14-0a06-4902-9d8c-23efd5612701" returned: 0 in 2.649s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:53 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ttaix1sjdevstack@QuobyteHD, size 112.00 MB, duration 2.65 sec, destination /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6b728e14-0a06-4902-9d8c-23efd5612701 {{(pid=86980) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:15:53 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Converted 112.00 MB image at 42.25 MB/s Sep 28 18:15:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6b728e14-0a06-4902-9d8c-23efd5612701 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:53 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6b728e14-0a06-4902-9d8c-23efd5612701 1G Sep 28 18:15:53 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:53 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-67313998-2dc7-4c5a-82af-dc3af8a79e14 tempest-TestInstancesWithCinderVolumes-359587429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f6776b57-536f-4121-9477-656e635367c8" returned: 0 in 0.332s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:53 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-67313998-2dc7-4c5a-82af-dc3af8a79e14 tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "cinder-quobyte-f6776b57-536f-4121-9477-656e635367c8" released by "delete_volume" :: held 1.022s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:53 devstack cinder-volume[86980]: WARNING cinder.quota [None req-67313998-2dc7-4c5a-82af-dc3af8a79e14 tempest-TestInstancesWithCinderVolumes-359587429 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1979607568-1968340972 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1979607568-1968340972, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:15:53 devstack cinder-volume[86980]: WARNING cinder.quota [None req-67313998-2dc7-4c5a-82af-dc3af8a79e14 tempest-TestInstancesWithCinderVolumes-359587429 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1979607568-1968340972 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1979607568-1968340972, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:15:53 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-67313998-2dc7-4c5a-82af-dc3af8a79e14 tempest-TestInstancesWithCinderVolumes-359587429 None] Created reservations ['9e77098d-8040-4dc9-b4d1-90247785ef68', 'b53898a5-40d1-4af7-8d90-0ec1530b2a13', '57ca5c84-75f9-46ab-88bc-21bae56889d9', '13574e39-b4cd-4d25-aae1-e4c1c17aeea5'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:15:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-67313998-2dc7-4c5a-82af-dc3af8a79e14 tempest-TestInstancesWithCinderVolumes-359587429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-67313998-2dc7-4c5a-82af-dc3af8a79e14 tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-67313998-2dc7-4c5a-82af-dc3af8a79e14 tempest-TestInstancesWithCinderVolumes-359587429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-67313998-2dc7-4c5a-82af-dc3af8a79e14 tempest-TestInstancesWithCinderVolumes-359587429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-67313998-2dc7-4c5a-82af-dc3af8a79e14 tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-67313998-2dc7-4c5a-82af-dc3af8a79e14 tempest-TestInstancesWithCinderVolumes-359587429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:53 devstack sudo[99823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:15:53 devstack sudo[99823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:54 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6b728e14-0a06-4902-9d8c-23efd5612701 1G" returned: 0 in 0.523s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:54 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Downloaded image d5838d4d-ebb7-4d18-8c3c-fc660c294083 ((None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}])) to volume 6b728e14-0a06-4902-9d8c-23efd5612701 successfully. {{(pid=86980) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:15:54 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Temporary image d5838d4d-ebb7-4d18-8c3c-fc660c294083 for user 394b2daed20c40368659402b44a6a650 is deleted. {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:15:54 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Marking volume 6b728e14-0a06-4902-9d8c-23efd5612701 as bootable. {{(pid=86980) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:15:54 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Copying metadata from image d5838d4d-ebb7-4d18-8c3c-fc660c294083 to 6b728e14-0a06-4902-9d8c-23efd5612701. {{(pid=86980) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:15:54 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Creating volume glance metadata for volume 6b728e14-0a06-4902-9d8c-23efd5612701 backed by image d5838d4d-ebb7-4d18-8c3c-fc660c294083 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86980) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:15:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ccaef21-d789-40be-bf2f-ba153ec82634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b728e14-0a06-4902-9d8c-23efd5612701', 'volume_size': 1, 'image_id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c13a4cea8f714bb0b9012709acb9372b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'created_at': datetime.datetime(2026, 9, 28, 15, 57, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 57, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af3a99f-7ce7-4ee7-8175-c50b48cd8762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:54 devstack sudo[99823]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-67313998-2dc7-4c5a-82af-dc3af8a79e14 tempest-TestInstancesWithCinderVolumes-359587429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.392s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:54 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-67313998-2dc7-4c5a-82af-dc3af8a79e14 tempest-TestInstancesWithCinderVolumes-359587429 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:15:54 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-67313998-2dc7-4c5a-82af-dc3af8a79e14 tempest-TestInstancesWithCinderVolumes-359587429 None] Deleted volume successfully. Sep 28 18:15:54 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Volume volume-6b728e14-0a06-4902-9d8c-23efd5612701 (6b728e14-0a06-4902-9d8c-23efd5612701): created successfully Sep 28 18:15:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af3a99f-7ce7-4ee7-8175-c50b48cd8762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Flow 'volume_create_manager' (562d8a5f-dc79-4771-a491-4050ffd9a1c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:54 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-4194145b-cbd4-4723-a63d-62dc59b28e58 tempest-VolumesGetTest-1204405293 None] Created volume successfully. Sep 28 18:15:54 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-67313998-2dc7-4c5a-82af-dc3af8a79e14 tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "cinder-f6776b57-536f-4121-9477-656e635367c8-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:15:56 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:15:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Flow 'volume_create_manager' (ee26a3e7-5052-4150-9a5e-c3be7671982e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b895b68b-4b1c-4989-a5f8-d78e69ae38ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b895b68b-4b1c-4989-a5f8-d78e69ae38ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-736449153',display_name='tempest-VolumesGetTest-Volume-1399001839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ef52012-8239-4850-8545-79114d76f92d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3acbf75f6a084113bb27c4f95674b305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:56Z,use_quota=True,user_id='394b2daed20c40368659402b44a6a650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9233560f-66ff-414a-a863-08a68911e8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9233560f-66ff-414a-a863-08a68911e8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9be67b8-5984-4114-8646-b2e75cfc8599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9be67b8-5984-4114-8646-b2e75cfc8599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ef52012-8239-4850-8545-79114d76f92d', 'volume_name': 'volume-1ef52012-8239-4850-8545-79114d76f92d', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b29e1c7b-3ec6-46c3-a1e5-67753df7c6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b29e1c7b-3ec6-46c3-a1e5-67753df7c6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb491d5-a286-4710-adae-806bbe35afc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:56 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Volume 1ef52012-8239-4850-8545-79114d76f92d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ef52012-8239-4850-8545-79114d76f92d', 'volume_size': 1} Sep 28 18:15:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-736449153',display_name='tempest-VolumesGetTest-Volume-1399001839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ef52012-8239-4850-8545-79114d76f92d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3acbf75f6a084113bb27c4f95674b305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:15:56Z,use_quota=True,user_id='394b2daed20c40368659402b44a6a650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:15:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Creating volume 1ef52012-8239-4850-8545-79114d76f92d {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:15:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:15:56 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:15:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1ef52012-8239-4850-8545-79114d76f92d 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:56 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1ef52012-8239-4850-8545-79114d76f92d 1073741824 Sep 28 18:15:56 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:57 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1ef52012-8239-4850-8545-79114d76f92d 1073741824" returned: 0 in 0.791s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1ef52012-8239-4850-8545-79114d76f92d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:57 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1ef52012-8239-4850-8545-79114d76f92d Sep 28 18:15:57 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:57 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Sep 28 18:15:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1ef52012-8239-4850-8545-79114d76f92d" returned: 0 in 0.321s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:15:57 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:15:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb491d5-a286-4710-adae-806bbe35afc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ef52012-8239-4850-8545-79114d76f92d', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7bbe0e1-2333-4a93-8756-d5efd42a4f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:58 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Volume volume-1ef52012-8239-4850-8545-79114d76f92d (1ef52012-8239-4850-8545-79114d76f92d): created successfully Sep 28 18:15:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7bbe0e1-2333-4a93-8756-d5efd42a4f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Flow 'volume_create_manager' (ee26a3e7-5052-4150-9a5e-c3be7671982e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:58 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-190d2adc-313e-4250-8812-284a6a4c73b8 tempest-VolumesGetTest-1204405293 None] Created volume successfully. Sep 28 18:15:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c16726ac-a338-4ede-865c-8d39ce9fcb8b tempest-VolumesGetTest-1204405293 None] Acquiring lock "cinder-1ef52012-8239-4850-8545-79114d76f92d-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c16726ac-a338-4ede-865c-8d39ce9fcb8b tempest-VolumesGetTest-1204405293 None] Lock "cinder-1ef52012-8239-4850-8545-79114d76f92d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:59 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-a9ae7f20-f3fa-4525-ba1c-d6aa29551938 req-1c95cb71-12b6-4277-95ba-f36714adf5a8 tempest-TestInstancesWithCinderVolumes-359587429 None] Terminate volume connection completed successfully. Sep 28 18:15:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-a9ae7f20-f3fa-4525-ba1c-d6aa29551938 req-1c95cb71-12b6-4277-95ba-f36714adf5a8 tempest-TestInstancesWithCinderVolumes-359587429 None] Deleting attachment e2b1cb75-9a33-4a9f-ad90-dd35337adcf7. {{(pid=86980) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:15:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c16726ac-a338-4ede-865c-8d39ce9fcb8b tempest-VolumesGetTest-1204405293 None] Acquiring lock "cinder-quobyte-1ef52012-8239-4850-8545-79114d76f92d" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:15:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c16726ac-a338-4ede-865c-8d39ce9fcb8b tempest-VolumesGetTest-1204405293 None] Lock "cinder-quobyte-1ef52012-8239-4850-8545-79114d76f92d" acquired by "delete_volume" :: waited 0.029s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:15:59 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8c5b9e-19cf-49e2-9d62-cac188bf88a9]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:15:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c16726ac-a338-4ede-865c-8d39ce9fcb8b tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1ef52012-8239-4850-8545-79114d76f92d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:15:59 devstack sudo[99907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1ef52012-8239-4850-8545-79114d76f92d Sep 28 18:15:59 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:15:59 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:15:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Flow 'volume_create_manager' (3214b9de-3bdb-4d93-9206-c00c02a7fa7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:15:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (089fb7a6-7ae7-4eae-b8f0-75a7369c379e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (089fb7a6-7ae7-4eae-b8f0-75a7369c379e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-387749302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b6611ba-4457-4d76-b7a0-2a0048406af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='412fa25ceb764578b67cde9e2e25c4ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:00Z,use_quota=True,user_id='a60dd66190e34af888ed44147f9b8399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81e9bddf-c420-412c-bf8f-91a05acbb4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81e9bddf-c420-412c-bf8f-91a05acbb4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa1d8a98-ef6a-4374-b14c-2e3ea082491d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa1d8a98-ef6a-4374-b14c-2e3ea082491d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b6611ba-4457-4d76-b7a0-2a0048406af1', 'volume_name': 'volume-7b6611ba-4457-4d76-b7a0-2a0048406af1', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7116c68-940b-441b-9c9a-4c7ce3b57fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7116c68-940b-441b-9c9a-4c7ce3b57fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:15:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6721f5d-e2b4-40d6-b855-6e7d2b162605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:15:59 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Volume 7b6611ba-4457-4d76-b7a0-2a0048406af1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b6611ba-4457-4d76-b7a0-2a0048406af1', 'volume_size': 1} Sep 28 18:15:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-387749302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b6611ba-4457-4d76-b7a0-2a0048406af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='412fa25ceb764578b67cde9e2e25c4ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:00Z,use_quota=True,user_id='a60dd66190e34af888ed44147f9b8399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:15:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Creating volume 7b6611ba-4457-4d76-b7a0-2a0048406af1 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:15:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:15:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:15:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:15:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:15:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:15:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:16:00 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:16:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7b6611ba-4457-4d76-b7a0-2a0048406af1 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:00 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c16726ac-a338-4ede-865c-8d39ce9fcb8b tempest-VolumesGetTest-1204405293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1ef52012-8239-4850-8545-79114d76f92d" returned: 0 in 0.784s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c16726ac-a338-4ede-865c-8d39ce9fcb8b tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1ef52012-8239-4850-8545-79114d76f92d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:00 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7b6611ba-4457-4d76-b7a0-2a0048406af1 1073741824 Sep 28 18:16:00 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:00 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1ef52012-8239-4850-8545-79114d76f92d Sep 28 18:16:00 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:00 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c16726ac-a338-4ede-865c-8d39ce9fcb8b tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1ef52012-8239-4850-8545-79114d76f92d" returned: 0 in 0.323s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c16726ac-a338-4ede-865c-8d39ce9fcb8b tempest-VolumesGetTest-1204405293 None] Lock "cinder-quobyte-1ef52012-8239-4850-8545-79114d76f92d" released by "delete_volume" :: held 1.190s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:00 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-c16726ac-a338-4ede-865c-8d39ce9fcb8b tempest-VolumesGetTest-1204405293 None] Created reservations ['f056b6f9-615b-4289-a67c-b16c6369ef3a', '5a77a4af-e5eb-4688-8d86-7c463229c901', 'bb8f7d34-424f-4e2f-bfbc-c12fb89d7c18', '4883ba44-f615-454a-97d7-5f48258b5f2d'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:16:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c16726ac-a338-4ede-865c-8d39ce9fcb8b tempest-VolumesGetTest-1204405293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c16726ac-a338-4ede-865c-8d39ce9fcb8b tempest-VolumesGetTest-1204405293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c16726ac-a338-4ede-865c-8d39ce9fcb8b tempest-VolumesGetTest-1204405293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c16726ac-a338-4ede-865c-8d39ce9fcb8b tempest-VolumesGetTest-1204405293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c16726ac-a338-4ede-865c-8d39ce9fcb8b tempest-VolumesGetTest-1204405293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c16726ac-a338-4ede-865c-8d39ce9fcb8b tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:00 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:16:00 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:00 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7b6611ba-4457-4d76-b7a0-2a0048406af1 1073741824" returned: 0 in 0.666s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7b6611ba-4457-4d76-b7a0-2a0048406af1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:00 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7b6611ba-4457-4d76-b7a0-2a0048406af1 Sep 28 18:16:00 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:00 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c16726ac-a338-4ede-865c-8d39ce9fcb8b tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.289s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:00 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-c16726ac-a338-4ede-865c-8d39ce9fcb8b tempest-VolumesGetTest-1204405293 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:16:00 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-c16726ac-a338-4ede-865c-8d39ce9fcb8b tempest-VolumesGetTest-1204405293 None] Deleted volume successfully. Sep 28 18:16:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c16726ac-a338-4ede-865c-8d39ce9fcb8b tempest-VolumesGetTest-1204405293 None] Lock "cinder-1ef52012-8239-4850-8545-79114d76f92d-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:00 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7b6611ba-4457-4d76-b7a0-2a0048406af1" returned: 0 in 0.277s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:16:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-8a0f7d76-9a0a-4e16-9df9-46df5cdd5263 tempest-TestInstancesWithCinderVolumes-359587429 None] Acquiring lock "cinder-2a91805d-b326-416a-9d78-88abd23b9cfb-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6721f5d-e2b4-40d6-b855-6e7d2b162605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b6611ba-4457-4d76-b7a0-2a0048406af1', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5778f37-ee54-48b2-a9ca-2efb0a637a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-8a0f7d76-9a0a-4e16-9df9-46df5cdd5263 tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "cinder-2a91805d-b326-416a-9d78-88abd23b9cfb-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:01 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Volume volume-7b6611ba-4457-4d76-b7a0-2a0048406af1 (7b6611ba-4457-4d76-b7a0-2a0048406af1): created successfully Sep 28 18:16:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5778f37-ee54-48b2-a9ca-2efb0a637a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Flow 'volume_create_manager' (3214b9de-3bdb-4d93-9206-c00c02a7fa7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:01 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-333c3f47-e574-4d6e-8da3-61add19c5b19 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Created volume successfully. Sep 28 18:16:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-8a0f7d76-9a0a-4e16-9df9-46df5cdd5263 tempest-TestInstancesWithCinderVolumes-359587429 None] Acquiring lock "cinder-quobyte-2a91805d-b326-416a-9d78-88abd23b9cfb" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-8a0f7d76-9a0a-4e16-9df9-46df5cdd5263 tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "cinder-quobyte-2a91805d-b326-416a-9d78-88abd23b9cfb" acquired by "delete_volume" :: waited 0.014s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:01 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6efa793-1eeb-43bf-b217-1485bac08f70]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8a0f7d76-9a0a-4e16-9df9-46df5cdd5263 tempest-TestInstancesWithCinderVolumes-359587429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a91805d-b326-416a-9d78-88abd23b9cfb {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:01 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a91805d-b326-416a-9d78-88abd23b9cfb Sep 28 18:16:01 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:01 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8a0f7d76-9a0a-4e16-9df9-46df5cdd5263 tempest-TestInstancesWithCinderVolumes-359587429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a91805d-b326-416a-9d78-88abd23b9cfb" returned: 0 in 0.411s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8a0f7d76-9a0a-4e16-9df9-46df5cdd5263 tempest-TestInstancesWithCinderVolumes-359587429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a91805d-b326-416a-9d78-88abd23b9cfb {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:01 devstack sudo[99939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a91805d-b326-416a-9d78-88abd23b9cfb Sep 28 18:16:01 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-aa21e63d-25f6-4464-ac2f-8332350bea86 tempest-VolumesGetTest-1204405293 None] Acquiring lock "cinder-6b728e14-0a06-4902-9d8c-23efd5612701-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-aa21e63d-25f6-4464-ac2f-8332350bea86 tempest-VolumesGetTest-1204405293 None] Lock "cinder-6b728e14-0a06-4902-9d8c-23efd5612701-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-aa21e63d-25f6-4464-ac2f-8332350bea86 tempest-VolumesGetTest-1204405293 None] Acquiring lock "cinder-quobyte-6b728e14-0a06-4902-9d8c-23efd5612701" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-aa21e63d-25f6-4464-ac2f-8332350bea86 tempest-VolumesGetTest-1204405293 None] Lock "cinder-quobyte-6b728e14-0a06-4902-9d8c-23efd5612701" acquired by "delete_volume" :: waited 0.023s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:01 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b86297-36e6-497a-93cf-d8b404d5afce]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-aa21e63d-25f6-4464-ac2f-8332350bea86 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6b728e14-0a06-4902-9d8c-23efd5612701 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:01 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8a0f7d76-9a0a-4e16-9df9-46df5cdd5263 tempest-TestInstancesWithCinderVolumes-359587429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a91805d-b326-416a-9d78-88abd23b9cfb" returned: 0 in 0.302s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-8a0f7d76-9a0a-4e16-9df9-46df5cdd5263 tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "cinder-quobyte-2a91805d-b326-416a-9d78-88abd23b9cfb" released by "delete_volume" :: held 0.755s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:01 devstack cinder-volume[86980]: WARNING cinder.quota [None req-8a0f7d76-9a0a-4e16-9df9-46df5cdd5263 tempest-TestInstancesWithCinderVolumes-359587429 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-450392492-330528715 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-450392492-330528715, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:16:01 devstack cinder-volume[86980]: WARNING cinder.quota [None req-8a0f7d76-9a0a-4e16-9df9-46df5cdd5263 tempest-TestInstancesWithCinderVolumes-359587429 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-450392492-330528715 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-450392492-330528715, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:16:01 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-8a0f7d76-9a0a-4e16-9df9-46df5cdd5263 tempest-TestInstancesWithCinderVolumes-359587429 None] Created reservations ['1590362e-4e06-46a9-9ea6-e838715e7cd9', 'c15e837e-3a3c-40a1-b870-67305ff7b351', '393181bc-6846-4503-8081-0669a07b5e9f', '58338c5a-da93-4064-bb51-c3d1ba72dd75'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:16:01 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6b728e14-0a06-4902-9d8c-23efd5612701 Sep 28 18:16:01 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8a0f7d76-9a0a-4e16-9df9-46df5cdd5263 tempest-TestInstancesWithCinderVolumes-359587429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8a0f7d76-9a0a-4e16-9df9-46df5cdd5263 tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8a0f7d76-9a0a-4e16-9df9-46df5cdd5263 tempest-TestInstancesWithCinderVolumes-359587429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8a0f7d76-9a0a-4e16-9df9-46df5cdd5263 tempest-TestInstancesWithCinderVolumes-359587429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8a0f7d76-9a0a-4e16-9df9-46df5cdd5263 tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8a0f7d76-9a0a-4e16-9df9-46df5cdd5263 tempest-TestInstancesWithCinderVolumes-359587429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:02 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:16:02 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:02 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-aa21e63d-25f6-4464-ac2f-8332350bea86 tempest-VolumesGetTest-1204405293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6b728e14-0a06-4902-9d8c-23efd5612701" returned: 0 in 0.656s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-aa21e63d-25f6-4464-ac2f-8332350bea86 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6b728e14-0a06-4902-9d8c-23efd5612701 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:02 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6b728e14-0a06-4902-9d8c-23efd5612701 Sep 28 18:16:02 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:02 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8a0f7d76-9a0a-4e16-9df9-46df5cdd5263 tempest-TestInstancesWithCinderVolumes-359587429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.518s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:02 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-8a0f7d76-9a0a-4e16-9df9-46df5cdd5263 tempest-TestInstancesWithCinderVolumes-359587429 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:16:02 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-8a0f7d76-9a0a-4e16-9df9-46df5cdd5263 tempest-TestInstancesWithCinderVolumes-359587429 None] Deleted volume successfully. Sep 28 18:16:02 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-8a0f7d76-9a0a-4e16-9df9-46df5cdd5263 tempest-TestInstancesWithCinderVolumes-359587429 None] Lock "cinder-2a91805d-b326-416a-9d78-88abd23b9cfb-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:03 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-aa21e63d-25f6-4464-ac2f-8332350bea86 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6b728e14-0a06-4902-9d8c-23efd5612701" returned: 0 in 0.521s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-aa21e63d-25f6-4464-ac2f-8332350bea86 tempest-VolumesGetTest-1204405293 None] Lock "cinder-quobyte-6b728e14-0a06-4902-9d8c-23efd5612701" released by "delete_volume" :: held 1.247s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Flow 'volume_create_manager' (7af516da-6edc-4b7c-b2dd-3b08e028f744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9d8e964-1545-4e68-bb55-2f96f5f93f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9d8e964-1545-4e68-bb55-2f96f5f93f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1018044712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e0b983b-b80f-4b6c-ba44-e9b7a4207a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22a1fe44f79a46519fcb0b238e16c192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:03Z,use_quota=True,user_id='91f10fdc436d495cbbbf80b57a95a973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6265a90-2636-4075-ae2b-1f8cdbd8a9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6265a90-2636-4075-ae2b-1f8cdbd8a9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f906de94-c974-4cef-9589-cfe834e4b6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f906de94-c974-4cef-9589-cfe834e4b6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e0b983b-b80f-4b6c-ba44-e9b7a4207a99', 'volume_name': 'volume-7e0b983b-b80f-4b6c-ba44-e9b7a4207a99', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b5e06dc-bf82-49c6-92c6-a6978125f72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b5e06dc-bf82-49c6-92c6-a6978125f72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3e677a-87e5-40e3-97eb-0cee4950a6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:03 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Volume 7e0b983b-b80f-4b6c-ba44-e9b7a4207a99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e0b983b-b80f-4b6c-ba44-e9b7a4207a99', 'volume_size': 1} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1018044712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e0b983b-b80f-4b6c-ba44-e9b7a4207a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22a1fe44f79a46519fcb0b238e16c192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:03Z,use_quota=True,user_id='91f10fdc436d495cbbbf80b57a95a973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Creating volume 7e0b983b-b80f-4b6c-ba44-e9b7a4207a99 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:16:03 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7e0b983b-b80f-4b6c-ba44-e9b7a4207a99 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-aa21e63d-25f6-4464-ac2f-8332350bea86 tempest-VolumesGetTest-1204405293 None] Created reservations ['0919d314-1fa9-4b2f-9277-22044c64c7fb', 'a7fb204c-134c-4f24-a55f-d83ef13024b7', '7e10719d-40ad-4fa0-9f2e-46463bf923f9', 'fc755185-ea80-4caa-834d-46615adaea5c'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:16:03 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7e0b983b-b80f-4b6c-ba44-e9b7a4207a99 1073741824 Sep 28 18:16:03 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-83fddb2f-dff5-452b-9844-ddb667c10c88 req-95ac09b0-faf5-42a8-8e2a-c5fbd68c9965 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-aa21e63d-25f6-4464-ac2f-8332350bea86 tempest-VolumesGetTest-1204405293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-aa21e63d-25f6-4464-ac2f-8332350bea86 tempest-VolumesGetTest-1204405293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-aa21e63d-25f6-4464-ac2f-8332350bea86 tempest-VolumesGetTest-1204405293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-aa21e63d-25f6-4464-ac2f-8332350bea86 tempest-VolumesGetTest-1204405293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-aa21e63d-25f6-4464-ac2f-8332350bea86 tempest-VolumesGetTest-1204405293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-aa21e63d-25f6-4464-ac2f-8332350bea86 tempest-VolumesGetTest-1204405293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:03 devstack sudo[99969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:16:03 devstack sudo[99969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:03 devstack sudo[99969]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-aa21e63d-25f6-4464-ac2f-8332350bea86 tempest-VolumesGetTest-1204405293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.360s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-aa21e63d-25f6-4464-ac2f-8332350bea86 tempest-VolumesGetTest-1204405293 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:16:03 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-aa21e63d-25f6-4464-ac2f-8332350bea86 tempest-VolumesGetTest-1204405293 None] Deleted volume successfully. Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-aa21e63d-25f6-4464-ac2f-8332350bea86 tempest-VolumesGetTest-1204405293 None] Lock "cinder-6b728e14-0a06-4902-9d8c-23efd5612701-delete_volume" released by "delete_volume" :: held 2.123s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:03 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7e0b983b-b80f-4b6c-ba44-e9b7a4207a99 1073741824" returned: 0 in 0.734s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7e0b983b-b80f-4b6c-ba44-e9b7a4207a99 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:04 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7e0b983b-b80f-4b6c-ba44-e9b7a4207a99 Sep 28 18:16:04 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:04 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7e0b983b-b80f-4b6c-ba44-e9b7a4207a99" returned: 0 in 0.347s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:16:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-83fddb2f-dff5-452b-9844-ddb667c10c88 req-95ac09b0-faf5-42a8-8e2a-c5fbd68c9965 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.983s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3e677a-87e5-40e3-97eb-0cee4950a6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e0b983b-b80f-4b6c-ba44-e9b7a4207a99', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eb92abe-467e-4afd-938d-373dec66e542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-83fddb2f-dff5-452b-9844-ddb667c10c88 req-95ac09b0-faf5-42a8-8e2a-c5fbd68c9965 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:04 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Volume volume-7e0b983b-b80f-4b6c-ba44-e9b7a4207a99 (7e0b983b-b80f-4b6c-ba44-e9b7a4207a99): created successfully Sep 28 18:16:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eb92abe-467e-4afd-938d-373dec66e542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Flow 'volume_create_manager' (7af516da-6edc-4b7c-b2dd-3b08e028f744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:04 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-c3fa20c5-e32a-4fb7-81e7-ababa352802c tempest-AttachVolumeNegativeTest-1060566598 None] Created volume successfully. Sep 28 18:16:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-83fddb2f-dff5-452b-9844-ddb667c10c88 req-95ac09b0-faf5-42a8-8e2a-c5fbd68c9965 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729', 'name': 'volume-7b6611ba-4457-4d76-b7a0-2a0048406af1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c43618bf-00c8-4303-b7ac-d2bf8cd98a82', 'enforce_multipath': True} {{(pid=86980) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:16:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:16:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:04 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-83fddb2f-dff5-452b-9844-ddb667c10c88 req-95ac09b0-faf5-42a8-8e2a-c5fbd68c9965 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] attachment_update completed successfully. Sep 28 18:16:04 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:16:04 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:04 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.370s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:04 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:16:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager._thread_info {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:16:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread count: 28 {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:16:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread info: [<_MainThread(MainThread, started 129097393381504)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:16:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-e1d2aa31-6904-4749-948c-2da0dca94d76 req-94168517-e4ac-4b1c-94ef-5ea54d6abd69 tempest-AttachVolumeNegativeTest-1060566598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-e1d2aa31-6904-4749-948c-2da0dca94d76 req-94168517-e4ac-4b1c-94ef-5ea54d6abd69 tempest-AttachVolumeNegativeTest-1060566598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-e1d2aa31-6904-4749-948c-2da0dca94d76 req-94168517-e4ac-4b1c-94ef-5ea54d6abd69 tempest-AttachVolumeNegativeTest-1060566598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-e1d2aa31-6904-4749-948c-2da0dca94d76 req-94168517-e4ac-4b1c-94ef-5ea54d6abd69 tempest-AttachVolumeNegativeTest-1060566598 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729', 'name': 'volume-7e0b983b-b80f-4b6c-ba44-e9b7a4207a99', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aa226369-9cd2-4bca-944e-76dd20da0519', 'enforce_multipath': True} {{(pid=86980) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:16:06 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-e1d2aa31-6904-4749-948c-2da0dca94d76 req-94168517-e4ac-4b1c-94ef-5ea54d6abd69 tempest-AttachVolumeNegativeTest-1060566598 None] attachment_update completed successfully. Sep 28 18:16:08 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-1240b004-4ee5-4ca7-a2f4-766b64091b57 req-93497db8-bbb4-4558-9788-852daf0ee1d6 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Terminate volume connection completed successfully. Sep 28 18:16:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-1240b004-4ee5-4ca7-a2f4-766b64091b57 req-93497db8-bbb4-4558-9788-852daf0ee1d6 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Deleting attachment c43618bf-00c8-4303-b7ac-d2bf8cd98a82. {{(pid=86980) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:16:09 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fc1749fd-4af1-42da-8839-9f3f6399c8c4 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Acquiring lock "cinder-7b6611ba-4457-4d76-b7a0-2a0048406af1-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:09 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fc1749fd-4af1-42da-8839-9f3f6399c8c4 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Lock "cinder-7b6611ba-4457-4d76-b7a0-2a0048406af1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:09 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fc1749fd-4af1-42da-8839-9f3f6399c8c4 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Acquiring lock "cinder-quobyte-7b6611ba-4457-4d76-b7a0-2a0048406af1" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:09 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-d800f998-6f82-41c4-8611-c0f532dd3811 req-48d58228-1bfc-4076-a505-aab35fd0ccde tempest-AttachVolumeNegativeTest-1060566598 None] Terminate volume connection completed successfully. Sep 28 18:16:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-d800f998-6f82-41c4-8611-c0f532dd3811 req-48d58228-1bfc-4076-a505-aab35fd0ccde tempest-AttachVolumeNegativeTest-1060566598 None] Deleting attachment aa226369-9cd2-4bca-944e-76dd20da0519. {{(pid=86980) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:16:09 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fc1749fd-4af1-42da-8839-9f3f6399c8c4 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Lock "cinder-quobyte-7b6611ba-4457-4d76-b7a0-2a0048406af1" acquired by "delete_volume" :: waited 0.052s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:09 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a10b770-a309-4c32-904d-d169bc3d31db]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fc1749fd-4af1-42da-8839-9f3f6399c8c4 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7b6611ba-4457-4d76-b7a0-2a0048406af1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:10 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7b6611ba-4457-4d76-b7a0-2a0048406af1 Sep 28 18:16:10 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:10 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fc1749fd-4af1-42da-8839-9f3f6399c8c4 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7b6611ba-4457-4d76-b7a0-2a0048406af1" returned: 0 in 0.626s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fc1749fd-4af1-42da-8839-9f3f6399c8c4 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7b6611ba-4457-4d76-b7a0-2a0048406af1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:10 devstack sudo[100460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7b6611ba-4457-4d76-b7a0-2a0048406af1 Sep 28 18:16:10 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:11 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fc1749fd-4af1-42da-8839-9f3f6399c8c4 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7b6611ba-4457-4d76-b7a0-2a0048406af1" returned: 0 in 0.436s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:11 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fc1749fd-4af1-42da-8839-9f3f6399c8c4 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Lock "cinder-quobyte-7b6611ba-4457-4d76-b7a0-2a0048406af1" released by "delete_volume" :: held 1.151s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:11 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-fc1749fd-4af1-42da-8839-9f3f6399c8c4 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Created reservations ['4809b8d2-30d5-4bbf-99e6-92202cb60255', '67c96142-f551-4d43-8f70-a739a608d214', 'd5feff37-5d24-4197-a194-bf659c2d2ee6', 'd9dfbab6-bf7b-422b-aa19-2eadbc706fb0'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:16:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-fc1749fd-4af1-42da-8839-9f3f6399c8c4 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-fc1749fd-4af1-42da-8839-9f3f6399c8c4 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:11 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-fc1749fd-4af1-42da-8839-9f3f6399c8c4 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:11 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-fc1749fd-4af1-42da-8839-9f3f6399c8c4 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-fc1749fd-4af1-42da-8839-9f3f6399c8c4 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fc1749fd-4af1-42da-8839-9f3f6399c8c4 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:11 devstack sudo[100465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:16:11 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:11 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fc1749fd-4af1-42da-8839-9f3f6399c8c4 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.396s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:11 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-fc1749fd-4af1-42da-8839-9f3f6399c8c4 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:16:11 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-fc1749fd-4af1-42da-8839-9f3f6399c8c4 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Deleted volume successfully. Sep 28 18:16:11 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fc1749fd-4af1-42da-8839-9f3f6399c8c4 tempest-TestServerVolumeAttachScenarioOldVersion-300199005 None] Lock "cinder-7b6611ba-4457-4d76-b7a0-2a0048406af1-delete_volume" released by "delete_volume" :: held 2.017s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:15 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:16:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Flow 'volume_create_manager' (73a3d4e1-f0ef-40f9-95ce-86f6de1c4bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0d013b-f7e4-4fa3-9ef7-2910f27c725b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e0d013b-f7e4-4fa3-9ef7-2910f27c725b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-727148766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9daa3da7-8934-4d88-85b6-e81fb56b0507,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='437435d0b69342f18b270917359f83ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:16Z,use_quota=True,user_id='ad0f5fa6f3384f82bafb3f3314d50e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c74906-1f16-4386-ac74-df15c8377062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c74906-1f16-4386-ac74-df15c8377062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e56c25-c7bd-47de-b121-531c8215febe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e56c25-c7bd-47de-b121-531c8215febe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9daa3da7-8934-4d88-85b6-e81fb56b0507', 'volume_name': 'volume-9daa3da7-8934-4d88-85b6-e81fb56b0507', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf33edf2-cc49-4f14-bd3b-e69b08dde3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf33edf2-cc49-4f14-bd3b-e69b08dde3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b78176e1-f55c-47ff-be20-1b71848b0da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:16 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Volume 9daa3da7-8934-4d88-85b6-e81fb56b0507: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9daa3da7-8934-4d88-85b6-e81fb56b0507', 'volume_size': 1} Sep 28 18:16:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-727148766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9daa3da7-8934-4d88-85b6-e81fb56b0507,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='437435d0b69342f18b270917359f83ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:16Z,use_quota=True,user_id='ad0f5fa6f3384f82bafb3f3314d50e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:16:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Creating volume 9daa3da7-8934-4d88-85b6-e81fb56b0507 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:16:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:16:16 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:16:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9daa3da7-8934-4d88-85b6-e81fb56b0507 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:16 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9daa3da7-8934-4d88-85b6-e81fb56b0507 1073741824 Sep 28 18:16:16 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:16 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9daa3da7-8934-4d88-85b6-e81fb56b0507 1073741824" returned: 0 in 0.825s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9daa3da7-8934-4d88-85b6-e81fb56b0507 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:16 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9daa3da7-8934-4d88-85b6-e81fb56b0507 Sep 28 18:16:16 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:17 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9daa3da7-8934-4d88-85b6-e81fb56b0507" returned: 0 in 0.445s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:17 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:16:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.347s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:17 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b78176e1-f55c-47ff-be20-1b71848b0da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9daa3da7-8934-4d88-85b6-e81fb56b0507', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:17 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c26baa83-e1fe-4e78-819c-69ee8629b32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:17 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Volume volume-9daa3da7-8934-4d88-85b6-e81fb56b0507 (9daa3da7-8934-4d88-85b6-e81fb56b0507): created successfully Sep 28 18:16:17 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c26baa83-e1fe-4e78-819c-69ee8629b32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:17 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Flow 'volume_create_manager' (73a3d4e1-f0ef-40f9-95ce-86f6de1c4bfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:17 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-d35b2c6d-7d2b-428e-9d3c-35f2cd913b82 tempest-VolumesListTestJSON-2036439555 None] Created volume successfully. Sep 28 18:16:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-433c6021-ef2e-489d-877a-134e00a7e8f6 tempest-AttachVolumeNegativeTest-1060566598 None] Acquiring lock "cinder-7e0b983b-b80f-4b6c-ba44-e9b7a4207a99-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-433c6021-ef2e-489d-877a-134e00a7e8f6 tempest-AttachVolumeNegativeTest-1060566598 None] Lock "cinder-7e0b983b-b80f-4b6c-ba44-e9b7a4207a99-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-433c6021-ef2e-489d-877a-134e00a7e8f6 tempest-AttachVolumeNegativeTest-1060566598 None] Acquiring lock "cinder-quobyte-7e0b983b-b80f-4b6c-ba44-e9b7a4207a99" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-433c6021-ef2e-489d-877a-134e00a7e8f6 tempest-AttachVolumeNegativeTest-1060566598 None] Lock "cinder-quobyte-7e0b983b-b80f-4b6c-ba44-e9b7a4207a99" acquired by "delete_volume" :: waited 0.039s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:18 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[845657fc-ebe7-456c-98b8-dc3eb702f585]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-433c6021-ef2e-489d-877a-134e00a7e8f6 tempest-AttachVolumeNegativeTest-1060566598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7e0b983b-b80f-4b6c-ba44-e9b7a4207a99 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:18 devstack sudo[100528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7e0b983b-b80f-4b6c-ba44-e9b7a4207a99 Sep 28 18:16:18 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:18 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:16:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Flow 'volume_create_manager' (a4bedf6a-c6b2-4a24-a59f-ab251ee6c4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b65cd1d0-bb97-48cf-8714-72cc28f5c85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b65cd1d0-bb97-48cf-8714-72cc28f5c85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1643458313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45643f70-a43e-4651-ab78-f8805620fc21,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='437435d0b69342f18b270917359f83ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:19Z,use_quota=True,user_id='ad0f5fa6f3384f82bafb3f3314d50e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00beec02-9949-4026-b6d8-ab5be1008a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00beec02-9949-4026-b6d8-ab5be1008a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:19 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58267397-0f71-454b-8442-19def8116c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:19 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58267397-0f71-454b-8442-19def8116c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45643f70-a43e-4651-ab78-f8805620fc21', 'volume_name': 'volume-45643f70-a43e-4651-ab78-f8805620fc21', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:19 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bee4b6b-a43b-46a3-b541-3e86207da1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:19 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bee4b6b-a43b-46a3-b541-3e86207da1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:19 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (066e455b-6ecb-48f4-b5f3-210d419bfdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:19 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Volume 45643f70-a43e-4651-ab78-f8805620fc21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45643f70-a43e-4651-ab78-f8805620fc21', 'volume_size': 1} Sep 28 18:16:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1643458313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45643f70-a43e-4651-ab78-f8805620fc21,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='437435d0b69342f18b270917359f83ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:19Z,use_quota=True,user_id='ad0f5fa6f3384f82bafb3f3314d50e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:16:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Creating volume 45643f70-a43e-4651-ab78-f8805620fc21 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:16:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:16:19 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:16:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-45643f70-a43e-4651-ab78-f8805620fc21 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:19 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-45643f70-a43e-4651-ab78-f8805620fc21 1073741824 Sep 28 18:16:19 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:19 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-433c6021-ef2e-489d-877a-134e00a7e8f6 tempest-AttachVolumeNegativeTest-1060566598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7e0b983b-b80f-4b6c-ba44-e9b7a4207a99" returned: 0 in 0.694s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-433c6021-ef2e-489d-877a-134e00a7e8f6 tempest-AttachVolumeNegativeTest-1060566598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7e0b983b-b80f-4b6c-ba44-e9b7a4207a99 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:19 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7e0b983b-b80f-4b6c-ba44-e9b7a4207a99 Sep 28 18:16:19 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:19 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-433c6021-ef2e-489d-877a-134e00a7e8f6 tempest-AttachVolumeNegativeTest-1060566598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7e0b983b-b80f-4b6c-ba44-e9b7a4207a99" returned: 0 in 0.369s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:19 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-433c6021-ef2e-489d-877a-134e00a7e8f6 tempest-AttachVolumeNegativeTest-1060566598 None] Lock "cinder-quobyte-7e0b983b-b80f-4b6c-ba44-e9b7a4207a99" released by "delete_volume" :: held 1.155s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:19 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-433c6021-ef2e-489d-877a-134e00a7e8f6 tempest-AttachVolumeNegativeTest-1060566598 None] Created reservations ['597fd0d9-b7ac-4787-8c7a-4f4aa614acb5', 'a2886cdd-fe99-468c-860f-7beaf38a0247', 'ef753865-c451-48cc-a580-91264a06b688', '8ce6ab13-dc82-44bb-9d81-aa5623990776'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:16:19 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-45643f70-a43e-4651-ab78-f8805620fc21 1073741824" returned: 0 in 0.702s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-45643f70-a43e-4651-ab78-f8805620fc21 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-433c6021-ef2e-489d-877a-134e00a7e8f6 tempest-AttachVolumeNegativeTest-1060566598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-433c6021-ef2e-489d-877a-134e00a7e8f6 tempest-AttachVolumeNegativeTest-1060566598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-433c6021-ef2e-489d-877a-134e00a7e8f6 tempest-AttachVolumeNegativeTest-1060566598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-433c6021-ef2e-489d-877a-134e00a7e8f6 tempest-AttachVolumeNegativeTest-1060566598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-433c6021-ef2e-489d-877a-134e00a7e8f6 tempest-AttachVolumeNegativeTest-1060566598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-433c6021-ef2e-489d-877a-134e00a7e8f6 tempest-AttachVolumeNegativeTest-1060566598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:19 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-45643f70-a43e-4651-ab78-f8805620fc21 Sep 28 18:16:19 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:19 devstack sudo[100543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:16:19 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:20 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-45643f70-a43e-4651-ab78-f8805620fc21" returned: 0 in 0.318s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:20 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:16:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (066e455b-6ecb-48f4-b5f3-210d419bfdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45643f70-a43e-4651-ab78-f8805620fc21', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089e964d-ecb0-4708-b298-1b3c9b7d7baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:20 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Volume volume-45643f70-a43e-4651-ab78-f8805620fc21 (45643f70-a43e-4651-ab78-f8805620fc21): created successfully Sep 28 18:16:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089e964d-ecb0-4708-b298-1b3c9b7d7baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Flow 'volume_create_manager' (a4bedf6a-c6b2-4a24-a59f-ab251ee6c4c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:20 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-f4544c4a-ac2c-4953-a25c-6e90c7fde6a6 tempest-VolumesListTestJSON-2036439555 None] Created volume successfully. Sep 28 18:16:20 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-433c6021-ef2e-489d-877a-134e00a7e8f6 tempest-AttachVolumeNegativeTest-1060566598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.417s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:20 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-433c6021-ef2e-489d-877a-134e00a7e8f6 tempest-AttachVolumeNegativeTest-1060566598 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:16:20 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-433c6021-ef2e-489d-877a-134e00a7e8f6 tempest-AttachVolumeNegativeTest-1060566598 None] Deleted volume successfully. Sep 28 18:16:20 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-433c6021-ef2e-489d-877a-134e00a7e8f6 tempest-AttachVolumeNegativeTest-1060566598 None] Lock "cinder-7e0b983b-b80f-4b6c-ba44-e9b7a4207a99-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-11dbd698-9997-445f-85ff-473ac9440093 tempest-AttachVolumeNegativeTest-1060566598 None] Acquiring lock "cinder-882d5f79-65b6-483d-880f-54bd497d3a61-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-11dbd698-9997-445f-85ff-473ac9440093 tempest-AttachVolumeNegativeTest-1060566598 None] Lock "cinder-882d5f79-65b6-483d-880f-54bd497d3a61-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-11dbd698-9997-445f-85ff-473ac9440093 tempest-AttachVolumeNegativeTest-1060566598 None] Acquiring lock "cinder-quobyte-882d5f79-65b6-483d-880f-54bd497d3a61" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-11dbd698-9997-445f-85ff-473ac9440093 tempest-AttachVolumeNegativeTest-1060566598 None] Lock "cinder-quobyte-882d5f79-65b6-483d-880f-54bd497d3a61" acquired by "delete_volume" :: waited 0.019s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd6ef73-118f-4852-bdb6-0fb5394a83f9]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-11dbd698-9997-445f-85ff-473ac9440093 tempest-AttachVolumeNegativeTest-1060566598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-882d5f79-65b6-483d-880f-54bd497d3a61 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:21 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-882d5f79-65b6-483d-880f-54bd497d3a61 Sep 28 18:16:21 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Flow 'volume_create_manager' (9f1e4a4e-a1c2-4594-b3a8-dd8e5d71732f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157fa6c9-93f5-4e26-b5d0-a4b5c03d6876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157fa6c9-93f5-4e26-b5d0-a4b5c03d6876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-495538354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0739321d-3488-4367-a4a5-76fbb81f2872,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='437435d0b69342f18b270917359f83ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:22Z,use_quota=True,user_id='ad0f5fa6f3384f82bafb3f3314d50e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81891034-f0bb-4126-a91f-10d1aaaf1bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81891034-f0bb-4126-a91f-10d1aaaf1bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc3e581-73aa-412d-b5dd-4a381e4e1ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc3e581-73aa-412d-b5dd-4a381e4e1ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0739321d-3488-4367-a4a5-76fbb81f2872', 'volume_name': 'volume-0739321d-3488-4367-a4a5-76fbb81f2872', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26ebb003-afae-4a1c-a097-a8242f4b60df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:21 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26ebb003-afae-4a1c-a097-a8242f4b60df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b46a75-31eb-4995-b082-324847cd1129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:21 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Volume 0739321d-3488-4367-a4a5-76fbb81f2872: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0739321d-3488-4367-a4a5-76fbb81f2872', 'volume_size': 1} Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-495538354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0739321d-3488-4367-a4a5-76fbb81f2872,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='437435d0b69342f18b270917359f83ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:22Z,use_quota=True,user_id='ad0f5fa6f3384f82bafb3f3314d50e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Creating volume 0739321d-3488-4367-a4a5-76fbb81f2872 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:16:21 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0739321d-3488-4367-a4a5-76fbb81f2872 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-11dbd698-9997-445f-85ff-473ac9440093 tempest-AttachVolumeNegativeTest-1060566598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-882d5f79-65b6-483d-880f-54bd497d3a61" returned: 0 in 0.704s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-11dbd698-9997-445f-85ff-473ac9440093 tempest-AttachVolumeNegativeTest-1060566598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-882d5f79-65b6-483d-880f-54bd497d3a61 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:21 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0739321d-3488-4367-a4a5-76fbb81f2872 1073741824 Sep 28 18:16:21 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:21 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-882d5f79-65b6-483d-880f-54bd497d3a61 Sep 28 18:16:22 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:22 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-11dbd698-9997-445f-85ff-473ac9440093 tempest-AttachVolumeNegativeTest-1060566598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-882d5f79-65b6-483d-880f-54bd497d3a61" returned: 0 in 0.518s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:22 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-11dbd698-9997-445f-85ff-473ac9440093 tempest-AttachVolumeNegativeTest-1060566598 None] Lock "cinder-quobyte-882d5f79-65b6-483d-880f-54bd497d3a61" released by "delete_volume" :: held 1.316s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:22 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-11dbd698-9997-445f-85ff-473ac9440093 tempest-AttachVolumeNegativeTest-1060566598 None] Created reservations ['cbb9da88-800d-47ff-8a92-cdc655871d59', '9d635778-f923-47ef-ab0f-a24f2a0e74ed', '2c174cb7-5ca7-4906-ae7b-3fc2a2b95792', '982742fa-140e-40b3-b2a7-f2baf82b7289'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:16:22 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0739321d-3488-4367-a4a5-76fbb81f2872 1073741824" returned: 0 in 0.761s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-11dbd698-9997-445f-85ff-473ac9440093 tempest-AttachVolumeNegativeTest-1060566598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-11dbd698-9997-445f-85ff-473ac9440093 tempest-AttachVolumeNegativeTest-1060566598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:22 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-11dbd698-9997-445f-85ff-473ac9440093 tempest-AttachVolumeNegativeTest-1060566598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:22 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-11dbd698-9997-445f-85ff-473ac9440093 tempest-AttachVolumeNegativeTest-1060566598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-11dbd698-9997-445f-85ff-473ac9440093 tempest-AttachVolumeNegativeTest-1060566598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-11dbd698-9997-445f-85ff-473ac9440093 tempest-AttachVolumeNegativeTest-1060566598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0739321d-3488-4367-a4a5-76fbb81f2872 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:22 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:16:22 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:22 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0739321d-3488-4367-a4a5-76fbb81f2872 Sep 28 18:16:22 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:23 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0739321d-3488-4367-a4a5-76fbb81f2872" returned: 0 in 0.347s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:16:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:23 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b46a75-31eb-4995-b082-324847cd1129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0739321d-3488-4367-a4a5-76fbb81f2872', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf773656-491f-4b93-aac9-e284ac542add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-11dbd698-9997-445f-85ff-473ac9440093 tempest-AttachVolumeNegativeTest-1060566598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.398s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:23 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-11dbd698-9997-445f-85ff-473ac9440093 tempest-AttachVolumeNegativeTest-1060566598 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:16:23 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-11dbd698-9997-445f-85ff-473ac9440093 tempest-AttachVolumeNegativeTest-1060566598 None] Deleted volume successfully. Sep 28 18:16:23 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Volume volume-0739321d-3488-4367-a4a5-76fbb81f2872 (0739321d-3488-4367-a4a5-76fbb81f2872): created successfully Sep 28 18:16:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf773656-491f-4b93-aac9-e284ac542add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Flow 'volume_create_manager' (9f1e4a4e-a1c2-4594-b3a8-dd8e5d71732f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-11dbd698-9997-445f-85ff-473ac9440093 tempest-AttachVolumeNegativeTest-1060566598 None] Lock "cinder-882d5f79-65b6-483d-880f-54bd497d3a61-delete_volume" released by "delete_volume" :: held 2.102s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:23 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-70f6c283-3298-4e0d-9982-cb8923cb5240 tempest-VolumesListTestJSON-2036439555 None] Created volume successfully. Sep 28 18:16:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e6387592-0aa9-4e01-bcdc-f76abeb0ac30 tempest-AttachVolumeNegativeTest-1060566598 None] Acquiring lock "cinder-ce7c90ba-7950-4c07-b263-50721c079315-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e6387592-0aa9-4e01-bcdc-f76abeb0ac30 tempest-AttachVolumeNegativeTest-1060566598 None] Lock "cinder-ce7c90ba-7950-4c07-b263-50721c079315-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e6387592-0aa9-4e01-bcdc-f76abeb0ac30 tempest-AttachVolumeNegativeTest-1060566598 None] Acquiring lock "cinder-quobyte-ce7c90ba-7950-4c07-b263-50721c079315" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e6387592-0aa9-4e01-bcdc-f76abeb0ac30 tempest-AttachVolumeNegativeTest-1060566598 None] Lock "cinder-quobyte-ce7c90ba-7950-4c07-b263-50721c079315" acquired by "delete_volume" :: waited 0.022s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:23 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b84dd33-35c8-4e08-a520-c78da0812f72]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e6387592-0aa9-4e01-bcdc-f76abeb0ac30 tempest-AttachVolumeNegativeTest-1060566598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ce7c90ba-7950-4c07-b263-50721c079315 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:24 devstack sudo[100571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ce7c90ba-7950-4c07-b263-50721c079315 Sep 28 18:16:24 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:24 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e6387592-0aa9-4e01-bcdc-f76abeb0ac30 tempest-AttachVolumeNegativeTest-1060566598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ce7c90ba-7950-4c07-b263-50721c079315" returned: 0 in 0.501s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e6387592-0aa9-4e01-bcdc-f76abeb0ac30 tempest-AttachVolumeNegativeTest-1060566598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ce7c90ba-7950-4c07-b263-50721c079315 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:24 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ce7c90ba-7950-4c07-b263-50721c079315 Sep 28 18:16:24 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:24 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e6387592-0aa9-4e01-bcdc-f76abeb0ac30 tempest-AttachVolumeNegativeTest-1060566598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ce7c90ba-7950-4c07-b263-50721c079315" returned: 0 in 0.363s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:24 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e6387592-0aa9-4e01-bcdc-f76abeb0ac30 tempest-AttachVolumeNegativeTest-1060566598 None] Lock "cinder-quobyte-ce7c90ba-7950-4c07-b263-50721c079315" released by "delete_volume" :: held 0.935s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:24 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-e6387592-0aa9-4e01-bcdc-f76abeb0ac30 tempest-AttachVolumeNegativeTest-1060566598 None] Created reservations ['90106cf1-48d9-4bd4-a844-d4a56f906d7b', '9746d31d-4039-491c-85ed-c4712b455fd9', '12487d12-065f-48f2-bd17-4880f0890823', '90d25350-967a-4abf-bea7-80366f08ab1e'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:16:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e6387592-0aa9-4e01-bcdc-f76abeb0ac30 tempest-AttachVolumeNegativeTest-1060566598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e6387592-0aa9-4e01-bcdc-f76abeb0ac30 tempest-AttachVolumeNegativeTest-1060566598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:25 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e6387592-0aa9-4e01-bcdc-f76abeb0ac30 tempest-AttachVolumeNegativeTest-1060566598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:25 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e6387592-0aa9-4e01-bcdc-f76abeb0ac30 tempest-AttachVolumeNegativeTest-1060566598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e6387592-0aa9-4e01-bcdc-f76abeb0ac30 tempest-AttachVolumeNegativeTest-1060566598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e6387592-0aa9-4e01-bcdc-f76abeb0ac30 tempest-AttachVolumeNegativeTest-1060566598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:25 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:16:25 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:25 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e6387592-0aa9-4e01-bcdc-f76abeb0ac30 tempest-AttachVolumeNegativeTest-1060566598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.351s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:25 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-e6387592-0aa9-4e01-bcdc-f76abeb0ac30 tempest-AttachVolumeNegativeTest-1060566598 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:16:25 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-e6387592-0aa9-4e01-bcdc-f76abeb0ac30 tempest-AttachVolumeNegativeTest-1060566598 None] Deleted volume successfully. Sep 28 18:16:25 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e6387592-0aa9-4e01-bcdc-f76abeb0ac30 tempest-AttachVolumeNegativeTest-1060566598 None] Lock "cinder-ce7c90ba-7950-4c07-b263-50721c079315-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:26 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1ce7c500-e6ae-440d-a03e-d30fff9b61b7 tempest-VolumesListTestJSON-2036439555 None] Acquiring lock "cinder-0739321d-3488-4367-a4a5-76fbb81f2872-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:26 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1ce7c500-e6ae-440d-a03e-d30fff9b61b7 tempest-VolumesListTestJSON-2036439555 None] Lock "cinder-0739321d-3488-4367-a4a5-76fbb81f2872-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:26 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1ce7c500-e6ae-440d-a03e-d30fff9b61b7 tempest-VolumesListTestJSON-2036439555 None] Acquiring lock "cinder-quobyte-0739321d-3488-4367-a4a5-76fbb81f2872" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:26 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1ce7c500-e6ae-440d-a03e-d30fff9b61b7 tempest-VolumesListTestJSON-2036439555 None] Lock "cinder-quobyte-0739321d-3488-4367-a4a5-76fbb81f2872" acquired by "delete_volume" :: waited 0.024s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:26 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[04454217-84fe-4e14-ba2d-2e34f19cd5da]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1ce7c500-e6ae-440d-a03e-d30fff9b61b7 tempest-VolumesListTestJSON-2036439555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0739321d-3488-4367-a4a5-76fbb81f2872 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:26 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0739321d-3488-4367-a4a5-76fbb81f2872 Sep 28 18:16:26 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:27 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1ce7c500-e6ae-440d-a03e-d30fff9b61b7 tempest-VolumesListTestJSON-2036439555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0739321d-3488-4367-a4a5-76fbb81f2872" returned: 0 in 0.566s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1ce7c500-e6ae-440d-a03e-d30fff9b61b7 tempest-VolumesListTestJSON-2036439555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0739321d-3488-4367-a4a5-76fbb81f2872 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:27 devstack sudo[100590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0739321d-3488-4367-a4a5-76fbb81f2872 Sep 28 18:16:27 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:27 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1ce7c500-e6ae-440d-a03e-d30fff9b61b7 tempest-VolumesListTestJSON-2036439555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0739321d-3488-4367-a4a5-76fbb81f2872" returned: 0 in 0.293s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:27 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1ce7c500-e6ae-440d-a03e-d30fff9b61b7 tempest-VolumesListTestJSON-2036439555 None] Lock "cinder-quobyte-0739321d-3488-4367-a4a5-76fbb81f2872" released by "delete_volume" :: held 0.929s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:27 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-1ce7c500-e6ae-440d-a03e-d30fff9b61b7 tempest-VolumesListTestJSON-2036439555 None] Created reservations ['6c2f0ac9-ed02-40ed-aa91-e9dcbe81ce51', '792d69b9-5784-4951-8cac-ebdbc46e651a', 'ce8c84fb-d9cb-45a9-b506-d081c0422e40', '45699e06-8a0a-4ef8-b1db-82cded28bf4f'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:16:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1ce7c500-e6ae-440d-a03e-d30fff9b61b7 tempest-VolumesListTestJSON-2036439555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1ce7c500-e6ae-440d-a03e-d30fff9b61b7 tempest-VolumesListTestJSON-2036439555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1ce7c500-e6ae-440d-a03e-d30fff9b61b7 tempest-VolumesListTestJSON-2036439555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1ce7c500-e6ae-440d-a03e-d30fff9b61b7 tempest-VolumesListTestJSON-2036439555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1ce7c500-e6ae-440d-a03e-d30fff9b61b7 tempest-VolumesListTestJSON-2036439555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1ce7c500-e6ae-440d-a03e-d30fff9b61b7 tempest-VolumesListTestJSON-2036439555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:27 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:16:27 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:28 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1ce7c500-e6ae-440d-a03e-d30fff9b61b7 tempest-VolumesListTestJSON-2036439555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.298s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:28 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-1ce7c500-e6ae-440d-a03e-d30fff9b61b7 tempest-VolumesListTestJSON-2036439555 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:16:28 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-1ce7c500-e6ae-440d-a03e-d30fff9b61b7 tempest-VolumesListTestJSON-2036439555 None] Deleted volume successfully. Sep 28 18:16:28 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1ce7c500-e6ae-440d-a03e-d30fff9b61b7 tempest-VolumesListTestJSON-2036439555 None] Lock "cinder-0739321d-3488-4367-a4a5-76fbb81f2872-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:29 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d9a3478a-fe53-4527-997e-58a8d6232eb2 tempest-VolumesListTestJSON-2036439555 None] Acquiring lock "cinder-45643f70-a43e-4651-ab78-f8805620fc21-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:29 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d9a3478a-fe53-4527-997e-58a8d6232eb2 tempest-VolumesListTestJSON-2036439555 None] Lock "cinder-45643f70-a43e-4651-ab78-f8805620fc21-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:29 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d9a3478a-fe53-4527-997e-58a8d6232eb2 tempest-VolumesListTestJSON-2036439555 None] Acquiring lock "cinder-quobyte-45643f70-a43e-4651-ab78-f8805620fc21" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:29 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d9a3478a-fe53-4527-997e-58a8d6232eb2 tempest-VolumesListTestJSON-2036439555 None] Lock "cinder-quobyte-45643f70-a43e-4651-ab78-f8805620fc21" acquired by "delete_volume" :: waited 0.023s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:29 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d05af4-9cc8-47e0-a5d9-92010bf2af2c]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d9a3478a-fe53-4527-997e-58a8d6232eb2 tempest-VolumesListTestJSON-2036439555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-45643f70-a43e-4651-ab78-f8805620fc21 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:29 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-45643f70-a43e-4651-ab78-f8805620fc21 Sep 28 18:16:29 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:29 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d9a3478a-fe53-4527-997e-58a8d6232eb2 tempest-VolumesListTestJSON-2036439555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-45643f70-a43e-4651-ab78-f8805620fc21" returned: 0 in 0.466s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d9a3478a-fe53-4527-997e-58a8d6232eb2 tempest-VolumesListTestJSON-2036439555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-45643f70-a43e-4651-ab78-f8805620fc21 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:29 devstack sudo[100603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-45643f70-a43e-4651-ab78-f8805620fc21 Sep 28 18:16:29 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:29 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d9a3478a-fe53-4527-997e-58a8d6232eb2 tempest-VolumesListTestJSON-2036439555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-45643f70-a43e-4651-ab78-f8805620fc21" returned: 0 in 0.288s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:29 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d9a3478a-fe53-4527-997e-58a8d6232eb2 tempest-VolumesListTestJSON-2036439555 None] Lock "cinder-quobyte-45643f70-a43e-4651-ab78-f8805620fc21" released by "delete_volume" :: held 0.812s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:30 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-d9a3478a-fe53-4527-997e-58a8d6232eb2 tempest-VolumesListTestJSON-2036439555 None] Created reservations ['f4f8a733-c2aa-4348-be2d-88b919bd2f34', 'c2a69b1f-fba0-4d2c-8ada-15c6c43c9ee5', 'd560a5aa-cbff-481a-b4a8-85bc4b804a0b', 'd7e64b7e-7aba-43e1-9391-c6b8df876b4b'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:16:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d9a3478a-fe53-4527-997e-58a8d6232eb2 tempest-VolumesListTestJSON-2036439555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d9a3478a-fe53-4527-997e-58a8d6232eb2 tempest-VolumesListTestJSON-2036439555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:30 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d9a3478a-fe53-4527-997e-58a8d6232eb2 tempest-VolumesListTestJSON-2036439555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:30 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d9a3478a-fe53-4527-997e-58a8d6232eb2 tempest-VolumesListTestJSON-2036439555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d9a3478a-fe53-4527-997e-58a8d6232eb2 tempest-VolumesListTestJSON-2036439555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d9a3478a-fe53-4527-997e-58a8d6232eb2 tempest-VolumesListTestJSON-2036439555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:30 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:16:30 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:30 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-021e0ff9-1678-4944-9fd3-e9b7058ab60e tempest-VolumesListTestJSON-2036439555 None] Acquiring lock "cinder-9daa3da7-8934-4d88-85b6-e81fb56b0507-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:30 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-021e0ff9-1678-4944-9fd3-e9b7058ab60e tempest-VolumesListTestJSON-2036439555 None] Lock "cinder-9daa3da7-8934-4d88-85b6-e81fb56b0507-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:30 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-021e0ff9-1678-4944-9fd3-e9b7058ab60e tempest-VolumesListTestJSON-2036439555 None] Acquiring lock "cinder-quobyte-9daa3da7-8934-4d88-85b6-e81fb56b0507" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:30 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-021e0ff9-1678-4944-9fd3-e9b7058ab60e tempest-VolumesListTestJSON-2036439555 None] Lock "cinder-quobyte-9daa3da7-8934-4d88-85b6-e81fb56b0507" acquired by "delete_volume" :: waited 0.030s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:30 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3006c7-9f5c-4f80-91e1-02f3a8cff70e]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-021e0ff9-1678-4944-9fd3-e9b7058ab60e tempest-VolumesListTestJSON-2036439555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9daa3da7-8934-4d88-85b6-e81fb56b0507 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:30 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d9a3478a-fe53-4527-997e-58a8d6232eb2 tempest-VolumesListTestJSON-2036439555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.430s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:30 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-d9a3478a-fe53-4527-997e-58a8d6232eb2 tempest-VolumesListTestJSON-2036439555 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:16:30 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-d9a3478a-fe53-4527-997e-58a8d6232eb2 tempest-VolumesListTestJSON-2036439555 None] Deleted volume successfully. Sep 28 18:16:30 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d9a3478a-fe53-4527-997e-58a8d6232eb2 tempest-VolumesListTestJSON-2036439555 None] Lock "cinder-45643f70-a43e-4651-ab78-f8805620fc21-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:30 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9daa3da7-8934-4d88-85b6-e81fb56b0507 Sep 28 18:16:30 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:31 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-021e0ff9-1678-4944-9fd3-e9b7058ab60e tempest-VolumesListTestJSON-2036439555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9daa3da7-8934-4d88-85b6-e81fb56b0507" returned: 0 in 0.481s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-021e0ff9-1678-4944-9fd3-e9b7058ab60e tempest-VolumesListTestJSON-2036439555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9daa3da7-8934-4d88-85b6-e81fb56b0507 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:31 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9daa3da7-8934-4d88-85b6-e81fb56b0507 Sep 28 18:16:31 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:31 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-021e0ff9-1678-4944-9fd3-e9b7058ab60e tempest-VolumesListTestJSON-2036439555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9daa3da7-8934-4d88-85b6-e81fb56b0507" returned: 0 in 0.365s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:31 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-021e0ff9-1678-4944-9fd3-e9b7058ab60e tempest-VolumesListTestJSON-2036439555 None] Lock "cinder-quobyte-9daa3da7-8934-4d88-85b6-e81fb56b0507" released by "delete_volume" :: held 0.936s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:31 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-021e0ff9-1678-4944-9fd3-e9b7058ab60e tempest-VolumesListTestJSON-2036439555 None] Created reservations ['db4e17a1-1ab1-42ff-abd9-35dcc2dc7785', '29740594-81f1-4b17-836e-9884c029229d', '1e276aeb-8cd8-44ea-9a20-a82847a940ee', 'c7748a30-831c-45a8-9586-d1d12461b1c3'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:16:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-021e0ff9-1678-4944-9fd3-e9b7058ab60e tempest-VolumesListTestJSON-2036439555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-021e0ff9-1678-4944-9fd3-e9b7058ab60e tempest-VolumesListTestJSON-2036439555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:31 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-021e0ff9-1678-4944-9fd3-e9b7058ab60e tempest-VolumesListTestJSON-2036439555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:31 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-021e0ff9-1678-4944-9fd3-e9b7058ab60e tempest-VolumesListTestJSON-2036439555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-021e0ff9-1678-4944-9fd3-e9b7058ab60e tempest-VolumesListTestJSON-2036439555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-021e0ff9-1678-4944-9fd3-e9b7058ab60e tempest-VolumesListTestJSON-2036439555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:31 devstack sudo[100618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:16:31 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:32 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-021e0ff9-1678-4944-9fd3-e9b7058ab60e tempest-VolumesListTestJSON-2036439555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.430s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:32 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-021e0ff9-1678-4944-9fd3-e9b7058ab60e tempest-VolumesListTestJSON-2036439555 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:16:32 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-021e0ff9-1678-4944-9fd3-e9b7058ab60e tempest-VolumesListTestJSON-2036439555 None] Deleted volume successfully. Sep 28 18:16:32 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-021e0ff9-1678-4944-9fd3-e9b7058ab60e tempest-VolumesListTestJSON-2036439555 None] Lock "cinder-9daa3da7-8934-4d88-85b6-e81fb56b0507-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:41 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=118,cinder:UPDATE=147,cinder:INSERT=37,cinder:DELETE=15 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:16:41 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:UPDATE=150,cinder:DELETE=8,cinder:SELECT=126,cinder:INSERT=43 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:16:41 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:16:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Flow 'volume_create_manager' (1aebc20a-e63f-4fef-bb2d-409f3c522e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af877a7c-d429-4d6c-b22f-e0b0a1bfc90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af877a7c-d429-4d6c-b22f-e0b0a1bfc90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-905229209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3de0aab7-a138-47eb-ab61-195f23bfa715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1603f60779824b2ebcb795daa4b817c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:41Z,use_quota=True,user_id='7fae6aac2e3944088f7fa951ed452c2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c4d3510-0c7c-4299-bed0-6c1f8178b787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c4d3510-0c7c-4299-bed0-6c1f8178b787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1fecee9-81a9-45a0-97e8-823840b18de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1fecee9-81a9-45a0-97e8-823840b18de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3de0aab7-a138-47eb-ab61-195f23bfa715', 'volume_name': 'volume-3de0aab7-a138-47eb-ab61-195f23bfa715', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba78618-fc89-426e-94da-046a4a35beea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba78618-fc89-426e-94da-046a4a35beea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29dd80a-39fd-4646-a680-75144befd5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:41 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Volume 3de0aab7-a138-47eb-ab61-195f23bfa715: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3de0aab7-a138-47eb-ab61-195f23bfa715', 'volume_size': 1} Sep 28 18:16:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:41 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-905229209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3de0aab7-a138-47eb-ab61-195f23bfa715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1603f60779824b2ebcb795daa4b817c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:41Z,use_quota=True,user_id='7fae6aac2e3944088f7fa951ed452c2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:16:41 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Creating volume 3de0aab7-a138-47eb-ab61-195f23bfa715 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:16:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:41 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:41 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:41 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:16:41 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:16:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3de0aab7-a138-47eb-ab61-195f23bfa715 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:41 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3de0aab7-a138-47eb-ab61-195f23bfa715 1073741824 Sep 28 18:16:41 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:42 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3de0aab7-a138-47eb-ab61-195f23bfa715 1073741824" returned: 0 in 0.682s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3de0aab7-a138-47eb-ab61-195f23bfa715 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:42 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3de0aab7-a138-47eb-ab61-195f23bfa715 Sep 28 18:16:42 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:42 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3de0aab7-a138-47eb-ab61-195f23bfa715" returned: 0 in 0.372s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:16:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:42 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29dd80a-39fd-4646-a680-75144befd5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3de0aab7-a138-47eb-ab61-195f23bfa715', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:42 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be0fc6bc-db99-4537-ba00-9a2ed51e4674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:42 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Volume volume-3de0aab7-a138-47eb-ab61-195f23bfa715 (3de0aab7-a138-47eb-ab61-195f23bfa715): created successfully Sep 28 18:16:42 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be0fc6bc-db99-4537-ba00-9a2ed51e4674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:42 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Flow 'volume_create_manager' (1aebc20a-e63f-4fef-bb2d-409f3c522e4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:42 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-94c4f022-9c57-43fa-86d7-dfc71038d9b5 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Created volume successfully. Sep 28 18:16:44 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:16:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Flow 'volume_create_manager' (fbae07f0-6cb2-43e5-aef7-c2d5dda94d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9a88892-bb1b-4573-8dd5-9c0eab6aef65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9a88892-bb1b-4573-8dd5-9c0eab6aef65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-407474293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48fe7ad9-83a9-46df-b8b4-fe020f0ddea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1603f60779824b2ebcb795daa4b817c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:44Z,use_quota=True,user_id='7fae6aac2e3944088f7fa951ed452c2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4bf65ff-0bbb-42cb-8f41-062d85a39f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4bf65ff-0bbb-42cb-8f41-062d85a39f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090cf902-7908-481d-b5d5-6d6deb0885bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090cf902-7908-481d-b5d5-6d6deb0885bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48fe7ad9-83a9-46df-b8b4-fe020f0ddea1', 'volume_name': 'volume-48fe7ad9-83a9-46df-b8b4-fe020f0ddea1', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21f510ea-ee17-41a9-a148-78f801302c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21f510ea-ee17-41a9-a148-78f801302c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d378fb59-9013-44be-b9f8-9014653db39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:44 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Volume 48fe7ad9-83a9-46df-b8b4-fe020f0ddea1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48fe7ad9-83a9-46df-b8b4-fe020f0ddea1', 'volume_size': 1} Sep 28 18:16:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:44 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-407474293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48fe7ad9-83a9-46df-b8b4-fe020f0ddea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1603f60779824b2ebcb795daa4b817c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:44Z,use_quota=True,user_id='7fae6aac2e3944088f7fa951ed452c2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:16:44 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Creating volume 48fe7ad9-83a9-46df-b8b4-fe020f0ddea1 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:16:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:44 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:44 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:44 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:16:44 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:16:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-48fe7ad9-83a9-46df-b8b4-fe020f0ddea1 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:44 devstack sudo[100636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-48fe7ad9-83a9-46df-b8b4-fe020f0ddea1 1073741824 Sep 28 18:16:44 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:45 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:16:45 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Flow 'volume_create_manager' (5adb95d5-2c00-49e8-b2cf-923958a36d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:45 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23d6d78-2910-43f0-8908-920d57078a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:45 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23d6d78-2910-43f0-8908-920d57078a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-146870131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77d71cfa-68f0-4a1a-845c-fa1464447b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1603f60779824b2ebcb795daa4b817c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:45Z,use_quota=True,user_id='7fae6aac2e3944088f7fa951ed452c2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:45 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7adc3b4-a3bc-412a-8925-972ffbafa25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:45 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7adc3b4-a3bc-412a-8925-972ffbafa25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:45 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad194b4-bea0-4d64-9b6c-dc433c88f643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:45 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad194b4-bea0-4d64-9b6c-dc433c88f643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77d71cfa-68f0-4a1a-845c-fa1464447b30', 'volume_name': 'volume-77d71cfa-68f0-4a1a-845c-fa1464447b30', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:45 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3cfe11d-9330-4169-93c1-8f340f28c39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:45 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3cfe11d-9330-4169-93c1-8f340f28c39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:45 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8da1e67-6e84-4693-b7ab-794609b5fc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:45 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Volume 77d71cfa-68f0-4a1a-845c-fa1464447b30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77d71cfa-68f0-4a1a-845c-fa1464447b30', 'volume_size': 1} Sep 28 18:16:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:45 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-48fe7ad9-83a9-46df-b8b4-fe020f0ddea1 1073741824" returned: 0 in 1.106s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-48fe7ad9-83a9-46df-b8b4-fe020f0ddea1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:45 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-48fe7ad9-83a9-46df-b8b4-fe020f0ddea1 Sep 28 18:16:45 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:45 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:16:45 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Flow 'volume_create_manager' (355a488d-8a23-494c-ac98-3df7620cf187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:45 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d72ffbbb-05d0-49ec-a45a-3614a1b89f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:46 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d72ffbbb-05d0-49ec-a45a-3614a1b89f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-106608993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e71847-8bb7-496b-9c0b-ef47c37fac52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1603f60779824b2ebcb795daa4b817c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:46Z,use_quota=True,user_id='7fae6aac2e3944088f7fa951ed452c2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:46 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afdadce0-381b-4b80-b09a-97492ca39ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:46 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afdadce0-381b-4b80-b09a-97492ca39ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:46 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba350cf-4940-4b9c-a403-9a3fbb140adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:46 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba350cf-4940-4b9c-a403-9a3fbb140adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40e71847-8bb7-496b-9c0b-ef47c37fac52', 'volume_name': 'volume-40e71847-8bb7-496b-9c0b-ef47c37fac52', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:46 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64082810-17b4-48ff-9799-db0000466c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:46 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64082810-17b4-48ff-9799-db0000466c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:46 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d89704ea-7691-45a0-b18e-ad233541076f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:46 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Volume 40e71847-8bb7-496b-9c0b-ef47c37fac52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40e71847-8bb7-496b-9c0b-ef47c37fac52', 'volume_size': 1} Sep 28 18:16:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:46 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-48fe7ad9-83a9-46df-b8b4-fe020f0ddea1" returned: 0 in 0.678s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:46 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] <== create_volume: return (1888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:16:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.896s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:46 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-146870131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77d71cfa-68f0-4a1a-845c-fa1464447b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1603f60779824b2ebcb795daa4b817c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:45Z,use_quota=True,user_id='7fae6aac2e3944088f7fa951ed452c2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:16:46 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Creating volume 77d71cfa-68f0-4a1a-845c-fa1464447b30 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:16:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:46 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:46 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:46 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:16:46 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:16:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-77d71cfa-68f0-4a1a-845c-fa1464447b30 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:46 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-77d71cfa-68f0-4a1a-845c-fa1464447b30 1073741824 Sep 28 18:16:46 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:46 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d378fb59-9013-44be-b9f8-9014653db39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48fe7ad9-83a9-46df-b8b4-fe020f0ddea1', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:46 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca30b65-df87-4b90-b59b-fc2e86ae820c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:46 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Volume volume-48fe7ad9-83a9-46df-b8b4-fe020f0ddea1 (48fe7ad9-83a9-46df-b8b4-fe020f0ddea1): created successfully Sep 28 18:16:46 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca30b65-df87-4b90-b59b-fc2e86ae820c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:46 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Flow 'volume_create_manager' (fbae07f0-6cb2-43e5-aef7-c2d5dda94d0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:46 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-3f0d756d-814e-460f-881b-2191d7df408a tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Created volume successfully. Sep 28 18:16:46 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-f7e5a98b-c8ba-4689-8437-36310eb916bb tempest-GroupSnapshotsV319Test-946815270 None] Group tempest-GroupSnapshotsV319Test-Group-449580413: creating Sep 28 18:16:46 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:16:46 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Flow 'volume_create_manager' (ee556fed-db66-4c42-b840-dc863fe370e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:46 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcaed010-200a-4413-a504-f1722041a681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcaed010-200a-4413-a504-f1722041a681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1521750515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebaaa04a-21c2-4ff6-ae89-ac2d5e6cbd45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1603f60779824b2ebcb795daa4b817c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:47Z,use_quota=True,user_id='7fae6aac2e3944088f7fa951ed452c2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dfa8d92-f2b2-405d-b70d-a022d8560a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dfa8d92-f2b2-405d-b70d-a022d8560a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6380640-57b8-459d-aca1-901f136dcec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6380640-57b8-459d-aca1-901f136dcec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebaaa04a-21c2-4ff6-ae89-ac2d5e6cbd45', 'volume_name': 'volume-ebaaa04a-21c2-4ff6-ae89-ac2d5e6cbd45', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe0e368-8f60-445c-ab29-9569714c4b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe0e368-8f60-445c-ab29-9569714c4b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69d94dfb-c609-4152-b6c4-9a7f0385f3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:47 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Volume ebaaa04a-21c2-4ff6-ae89-ac2d5e6cbd45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebaaa04a-21c2-4ff6-ae89-ac2d5e6cbd45', 'volume_size': 1} Sep 28 18:16:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:47 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-f7e5a98b-c8ba-4689-8437-36310eb916bb tempest-GroupSnapshotsV319Test-946815270 None] Group tempest-GroupSnapshotsV319Test-Group-449580413: created successfully Sep 28 18:16:47 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-f7e5a98b-c8ba-4689-8437-36310eb916bb tempest-GroupSnapshotsV319Test-946815270 None] Create group completed successfully. Sep 28 18:16:47 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:16:47 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Flow 'volume_create_manager' (f7d4800f-aa78-46bc-b3d7-e249a3c9e5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (913aba23-4d23-46aa-9c94-55b2d5a176ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-77d71cfa-68f0-4a1a-845c-fa1464447b30 1073741824" returned: 0 in 1.009s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (913aba23-4d23-46aa-9c94-55b2d5a176ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1071203241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5b375a9-6674-408b-9c8b-437afac4b8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1603f60779824b2ebcb795daa4b817c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:47Z,use_quota=True,user_id='7fae6aac2e3944088f7fa951ed452c2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad9d30f5-1ba6-402e-9863-f32aad29bc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad9d30f5-1ba6-402e-9863-f32aad29bc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5134812-d3e1-41e5-8de5-96a2ad2e8927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5134812-d3e1-41e5-8de5-96a2ad2e8927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5b375a9-6674-408b-9c8b-437afac4b8f1', 'volume_name': 'volume-e5b375a9-6674-408b-9c8b-437afac4b8f1', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f33f67-d1c2-4e4f-bbd6-d982c14c6723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f33f67-d1c2-4e4f-bbd6-d982c14c6723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64409754-5890-4e75-ad75-3cb3a72ad316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:47 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Volume e5b375a9-6674-408b-9c8b-437afac4b8f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5b375a9-6674-408b-9c8b-437afac4b8f1', 'volume_size': 1} Sep 28 18:16:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-77d71cfa-68f0-4a1a-845c-fa1464447b30 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:47 devstack sudo[100654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-77d71cfa-68f0-4a1a-845c-fa1464447b30 Sep 28 18:16:47 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:48 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-77d71cfa-68f0-4a1a-845c-fa1464447b30" returned: 0 in 0.383s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.849s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-106608993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e71847-8bb7-496b-9c0b-ef47c37fac52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1603f60779824b2ebcb795daa4b817c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:46Z,use_quota=True,user_id='7fae6aac2e3944088f7fa951ed452c2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Creating volume 40e71847-8bb7-496b-9c0b-ef47c37fac52 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:16:48 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-40e71847-8bb7-496b-9c0b-ef47c37fac52 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8da1e67-6e84-4693-b7ab-794609b5fc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77d71cfa-68f0-4a1a-845c-fa1464447b30', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:48 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-40e71847-8bb7-496b-9c0b-ef47c37fac52 1073741824 Sep 28 18:16:48 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7db407-afbf-4675-b517-b92ab69fbacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:48 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Volume volume-77d71cfa-68f0-4a1a-845c-fa1464447b30 (77d71cfa-68f0-4a1a-845c-fa1464447b30): created successfully Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7db407-afbf-4675-b517-b92ab69fbacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Flow 'volume_create_manager' (5adb95d5-2c00-49e8-b2cf-923958a36d66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:48 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-0d0717bf-e09d-46c6-b9d8-d8958047cafa tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Created volume successfully. Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Flow 'volume_create_manager' (d4ecd554-222f-4efa-ad01-a3a2b384bb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d92b023-e2f2-436c-ad02-dec18a142aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d92b023-e2f2-436c-ad02-dec18a142aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-973108703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9846acf7-d24e-49a1-9bf5-b24fde6a208a,host='devstack@QuobyteHD#QuobyteHD',id=2d24de28-750b-44ec-b671-62a461bd1ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0357b5d3be4d4786d4bc90fb891407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:48Z,use_quota=True,user_id='2b4ed4f3ae924fe3a2dadd6a767a59ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(805e0bcb-3f3b-483a-a366-381abc91d141),volume_type_id=805e0bcb-3f3b-483a-a366-381abc91d141)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b5c2e68-abe9-4287-8a81-277cbce23d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b5c2e68-abe9-4287-8a81-277cbce23d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c812e3b-f79b-4dc0-9ddd-09171068d66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c812e3b-f79b-4dc0-9ddd-09171068d66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d24de28-750b-44ec-b671-62a461bd1ee3', 'volume_name': 'volume-2d24de28-750b-44ec-b671-62a461bd1ee3', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3817aa1f-629c-4967-90ab-f3c79ca7c4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3817aa1f-629c-4967-90ab-f3c79ca7c4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b1b69c1-a415-4112-b549-67fcdae1d17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:48 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Volume 2d24de28-750b-44ec-b671-62a461bd1ee3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d24de28-750b-44ec-b671-62a461bd1ee3', 'volume_size': 1} Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:48 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-40e71847-8bb7-496b-9c0b-ef47c37fac52 1073741824" returned: 0 in 0.788s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-40e71847-8bb7-496b-9c0b-ef47c37fac52 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:48 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-40e71847-8bb7-496b-9c0b-ef47c37fac52 Sep 28 18:16:48 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:49 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-40e71847-8bb7-496b-9c0b-ef47c37fac52" returned: 0 in 0.346s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:16:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.163s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1521750515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebaaa04a-21c2-4ff6-ae89-ac2d5e6cbd45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1603f60779824b2ebcb795daa4b817c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:47Z,use_quota=True,user_id='7fae6aac2e3944088f7fa951ed452c2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:16:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Creating volume ebaaa04a-21c2-4ff6-ae89-ac2d5e6cbd45 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:16:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:16:49 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:16:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebaaa04a-21c2-4ff6-ae89-ac2d5e6cbd45 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d89704ea-7691-45a0-b18e-ad233541076f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40e71847-8bb7-496b-9c0b-ef47c37fac52', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38c39cb6-c4a2-4ab5-8083-338e2fff9c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:49 devstack sudo[100666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebaaa04a-21c2-4ff6-ae89-ac2d5e6cbd45 1073741824 Sep 28 18:16:49 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:49 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Volume volume-40e71847-8bb7-496b-9c0b-ef47c37fac52 (40e71847-8bb7-496b-9c0b-ef47c37fac52): created successfully Sep 28 18:16:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38c39cb6-c4a2-4ab5-8083-338e2fff9c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Flow 'volume_create_manager' (355a488d-8a23-494c-ac98-3df7620cf187) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:49 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-bee5cdc3-c137-41f7-8875-801197143297 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Created volume successfully. Sep 28 18:16:49 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebaaa04a-21c2-4ff6-ae89-ac2d5e6cbd45 1073741824" returned: 0 in 0.626s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebaaa04a-21c2-4ff6-ae89-ac2d5e6cbd45 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:49 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebaaa04a-21c2-4ff6-ae89-ac2d5e6cbd45 Sep 28 18:16:49 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:50 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebaaa04a-21c2-4ff6-ae89-ac2d5e6cbd45" returned: 0 in 0.294s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:16:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.629s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1071203241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5b375a9-6674-408b-9c8b-437afac4b8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1603f60779824b2ebcb795daa4b817c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:47Z,use_quota=True,user_id='7fae6aac2e3944088f7fa951ed452c2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:16:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Creating volume e5b375a9-6674-408b-9c8b-437afac4b8f1 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:16:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:16:50 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:16:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e5b375a9-6674-408b-9c8b-437afac4b8f1 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69d94dfb-c609-4152-b6c4-9a7f0385f3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebaaa04a-21c2-4ff6-ae89-ac2d5e6cbd45', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:50 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e5b375a9-6674-408b-9c8b-437afac4b8f1 1073741824 Sep 28 18:16:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304221ff-3ec4-4ab7-aba7-94d1ad0985c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:50 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:50 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Volume volume-ebaaa04a-21c2-4ff6-ae89-ac2d5e6cbd45 (ebaaa04a-21c2-4ff6-ae89-ac2d5e6cbd45): created successfully Sep 28 18:16:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304221ff-3ec4-4ab7-aba7-94d1ad0985c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Flow 'volume_create_manager' (ee556fed-db66-4c42-b840-dc863fe370e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:50 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-4c230bbc-9489-4c5d-8987-f33ab5c100c8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Created volume successfully. Sep 28 18:16:51 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e5b375a9-6674-408b-9c8b-437afac4b8f1 1073741824" returned: 0 in 0.872s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e5b375a9-6674-408b-9c8b-437afac4b8f1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:51 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e5b375a9-6674-408b-9c8b-437afac4b8f1 Sep 28 18:16:51 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:51 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e5b375a9-6674-408b-9c8b-437afac4b8f1" returned: 0 in 0.386s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:51 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:16:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.792s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:51 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9846acf7-d24e-49a1-9bf5-b24fde6a208a,created_at=2026-09-28T16:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-973108703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9846acf7-d24e-49a1-9bf5-b24fde6a208a,host='devstack@QuobyteHD#QuobyteHD',id=2d24de28-750b-44ec-b671-62a461bd1ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0357b5d3be4d4786d4bc90fb891407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:16:48Z,use_quota=True,user_id='2b4ed4f3ae924fe3a2dadd6a767a59ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(805e0bcb-3f3b-483a-a366-381abc91d141),volume_type_id=805e0bcb-3f3b-483a-a366-381abc91d141)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:16:51 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Creating volume 2d24de28-750b-44ec-b671-62a461bd1ee3 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:16:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:51 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:51 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:51 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:16:51 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:16:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:51 devstack sudo[100685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3 1073741824 Sep 28 18:16:51 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64409754-5890-4e75-ad75-3cb3a72ad316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5b375a9-6674-408b-9c8b-437afac4b8f1', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82fee07d-82ee-4fc6-b8be-c73802050611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:51 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Volume volume-e5b375a9-6674-408b-9c8b-437afac4b8f1 (e5b375a9-6674-408b-9c8b-437afac4b8f1): created successfully Sep 28 18:16:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82fee07d-82ee-4fc6-b8be-c73802050611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Flow 'volume_create_manager' (f7d4800f-aa78-46bc-b3d7-e249a3c9e5cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:51 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-37a215ef-e87c-4f69-a72d-9f599e9aac15 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Created volume successfully. Sep 28 18:16:52 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0ff7d61c-63ce-4511-9204-fa4a795185b2 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "cinder-e5b375a9-6674-408b-9c8b-437afac4b8f1-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:52 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0ff7d61c-63ce-4511-9204-fa4a795185b2 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "cinder-e5b375a9-6674-408b-9c8b-437afac4b8f1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:52 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0ff7d61c-63ce-4511-9204-fa4a795185b2 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "cinder-quobyte-e5b375a9-6674-408b-9c8b-437afac4b8f1" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:52 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0ff7d61c-63ce-4511-9204-fa4a795185b2 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "cinder-quobyte-e5b375a9-6674-408b-9c8b-437afac4b8f1" acquired by "delete_volume" :: waited 0.031s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:52 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[01894fc0-6b8f-492c-8927-ae21c39ae7db]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0ff7d61c-63ce-4511-9204-fa4a795185b2 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e5b375a9-6674-408b-9c8b-437afac4b8f1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:52 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3 1073741824" returned: 0 in 0.744s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:52 devstack sudo[100692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3 Sep 28 18:16:52 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:52 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e5b375a9-6674-408b-9c8b-437afac4b8f1 Sep 28 18:16:52 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:52 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3" returned: 0 in 0.417s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:52 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:16:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:52 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0ff7d61c-63ce-4511-9204-fa4a795185b2 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e5b375a9-6674-408b-9c8b-437afac4b8f1" returned: 0 in 0.575s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0ff7d61c-63ce-4511-9204-fa4a795185b2 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e5b375a9-6674-408b-9c8b-437afac4b8f1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b1b69c1-a415-4112-b549-67fcdae1d17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d24de28-750b-44ec-b671-62a461bd1ee3', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:52 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e5b375a9-6674-408b-9c8b-437afac4b8f1 Sep 28 18:16:52 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9b816f-fb72-403c-925c-7e9b5a1ef851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:16:52 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Volume volume-2d24de28-750b-44ec-b671-62a461bd1ee3 (2d24de28-750b-44ec-b671-62a461bd1ee3): created successfully Sep 28 18:16:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9b816f-fb72-403c-925c-7e9b5a1ef851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:16:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Flow 'volume_create_manager' (d4ecd554-222f-4efa-ad01-a3a2b384bb39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:16:52 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-1e265854-33d5-4e88-87b6-8a70241404b1 tempest-GroupSnapshotsV319Test-946815270 None] Created volume successfully. Sep 28 18:16:53 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0ff7d61c-63ce-4511-9204-fa4a795185b2 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e5b375a9-6674-408b-9c8b-437afac4b8f1" returned: 0 in 0.594s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:53 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0ff7d61c-63ce-4511-9204-fa4a795185b2 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "cinder-quobyte-e5b375a9-6674-408b-9c8b-437afac4b8f1" released by "delete_volume" :: held 1.252s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:53 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-0ff7d61c-63ce-4511-9204-fa4a795185b2 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Created reservations ['3a446016-bffe-4c4d-b749-59db2f5af269', 'dcccde15-6048-4130-97a6-76dceaf9059a', '53c3f73e-075f-4a4b-847d-2c7699798a6e', '8857d0ab-78fd-41cd-bca0-839d166296b0'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:16:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0ff7d61c-63ce-4511-9204-fa4a795185b2 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0ff7d61c-63ce-4511-9204-fa4a795185b2 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0ff7d61c-63ce-4511-9204-fa4a795185b2 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0ff7d61c-63ce-4511-9204-fa4a795185b2 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0ff7d61c-63ce-4511-9204-fa4a795185b2 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0ff7d61c-63ce-4511-9204-fa4a795185b2 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:53 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:16:53 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:54 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-a23463fd-ab12-49b2-baf8-f3a7e3b39b9d tempest-GroupSnapshotsV319Test-946815270 None] GroupSnapshot 504132c6-1db6-4e12-9edf-6b4b28631e6a: creating. Sep 28 18:16:54 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0ff7d61c-63ce-4511-9204-fa4a795185b2 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.474s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:54 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-0ff7d61c-63ce-4511-9204-fa4a795185b2 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:16:54 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-0ff7d61c-63ce-4511-9204-fa4a795185b2 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Deleted volume successfully. Sep 28 18:16:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a23463fd-ab12-49b2-baf8-f3a7e3b39b9d tempest-GroupSnapshotsV319Test-946815270 None] Group snapshot 504132c6-1db6-4e12-9edf-6b4b28631e6a: creating. {{(pid=86980) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 18:16:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a23463fd-ab12-49b2-baf8-f3a7e3b39b9d tempest-GroupSnapshotsV319Test-946815270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a23463fd-ab12-49b2-baf8-f3a7e3b39b9d tempest-GroupSnapshotsV319Test-946815270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:54 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0ff7d61c-63ce-4511-9204-fa4a795185b2 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "cinder-e5b375a9-6674-408b-9c8b-437afac4b8f1-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-a23463fd-ab12-49b2-baf8-f3a7e3b39b9d tempest-GroupSnapshotsV319Test-946815270 None] Creating offline snapshot 83dbc213-8c2a-45c9-aed9-c1f61cfbf953 of volume 2d24de28-750b-44ec-b671-62a461bd1ee3 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:16:54 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d308566a-c88b-4cc5-a0f0-dafb130a448b]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a23463fd-ab12-49b2-baf8-f3a7e3b39b9d tempest-GroupSnapshotsV319Test-946815270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:54 devstack sudo[100705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3 Sep 28 18:16:54 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:54 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-15c22aba-eab7-44df-8236-65f15a14175b tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "cinder-ebaaa04a-21c2-4ff6-ae89-ac2d5e6cbd45-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:54 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-15c22aba-eab7-44df-8236-65f15a14175b tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "cinder-ebaaa04a-21c2-4ff6-ae89-ac2d5e6cbd45-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:54 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-15c22aba-eab7-44df-8236-65f15a14175b tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "cinder-quobyte-ebaaa04a-21c2-4ff6-ae89-ac2d5e6cbd45" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:54 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-15c22aba-eab7-44df-8236-65f15a14175b tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "cinder-quobyte-ebaaa04a-21c2-4ff6-ae89-ac2d5e6cbd45" acquired by "delete_volume" :: waited 0.019s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:54 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[648ee87d-7cbc-4f56-85a0-7e7332a569e3]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-15c22aba-eab7-44df-8236-65f15a14175b tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebaaa04a-21c2-4ff6-ae89-ac2d5e6cbd45 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:54 devstack sudo[100707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebaaa04a-21c2-4ff6-ae89-ac2d5e6cbd45 Sep 28 18:16:54 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:54 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a23463fd-ab12-49b2-baf8-f3a7e3b39b9d tempest-GroupSnapshotsV319Test-946815270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3" returned: 0 in 0.617s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a23463fd-ab12-49b2-baf8-f3a7e3b39b9d tempest-GroupSnapshotsV319Test-946815270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3.83dbc213-8c2a-45c9-aed9-c1f61cfbf953 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:54 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3.83dbc213-8c2a-45c9-aed9-c1f61cfbf953 1G Sep 28 18:16:54 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:55 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-15c22aba-eab7-44df-8236-65f15a14175b tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebaaa04a-21c2-4ff6-ae89-ac2d5e6cbd45" returned: 0 in 0.588s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-15c22aba-eab7-44df-8236-65f15a14175b tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebaaa04a-21c2-4ff6-ae89-ac2d5e6cbd45 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:55 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebaaa04a-21c2-4ff6-ae89-ac2d5e6cbd45 Sep 28 18:16:55 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:55 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:55 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-15c22aba-eab7-44df-8236-65f15a14175b tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebaaa04a-21c2-4ff6-ae89-ac2d5e6cbd45" returned: 0 in 0.497s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a23463fd-ab12-49b2-baf8-f3a7e3b39b9d tempest-GroupSnapshotsV319Test-946815270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3.83dbc213-8c2a-45c9-aed9-c1f61cfbf953 1G" returned: 0 in 0.902s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a23463fd-ab12-49b2-baf8-f3a7e3b39b9d tempest-GroupSnapshotsV319Test-946815270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d24de28-750b-44ec-b671-62a461bd1ee3 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3.83dbc213-8c2a-45c9-aed9-c1f61cfbf953 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-15c22aba-eab7-44df-8236-65f15a14175b tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "cinder-quobyte-ebaaa04a-21c2-4ff6-ae89-ac2d5e6cbd45" released by "delete_volume" :: held 1.195s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:55 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d24de28-750b-44ec-b671-62a461bd1ee3 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3.83dbc213-8c2a-45c9-aed9-c1f61cfbf953 Sep 28 18:16:55 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:56 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-15c22aba-eab7-44df-8236-65f15a14175b tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Created reservations ['decbf971-157f-4fee-889e-569a7d26c0b7', 'ff9ff336-af31-4cdb-a4f3-fcdd661e7aca', '83663f94-6a1e-4c79-8e4a-7d838846512f', '14e1983e-1506-4218-ab0e-efd23dbec04d'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:16:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-15c22aba-eab7-44df-8236-65f15a14175b tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-15c22aba-eab7-44df-8236-65f15a14175b tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-15c22aba-eab7-44df-8236-65f15a14175b tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-15c22aba-eab7-44df-8236-65f15a14175b tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-15c22aba-eab7-44df-8236-65f15a14175b tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-15c22aba-eab7-44df-8236-65f15a14175b tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:56 devstack sudo[100760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:16:56 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:56 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a23463fd-ab12-49b2-baf8-f3a7e3b39b9d tempest-GroupSnapshotsV319Test-946815270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d24de28-750b-44ec-b671-62a461bd1ee3 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3.83dbc213-8c2a-45c9-aed9-c1f61cfbf953" returned: 0 in 0.567s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:56 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-a23463fd-ab12-49b2-baf8-f3a7e3b39b9d tempest-GroupSnapshotsV319Test-946815270 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3.83dbc213-8c2a-45c9-aed9-c1f61cfbf953 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:16:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a23463fd-ab12-49b2-baf8-f3a7e3b39b9d tempest-GroupSnapshotsV319Test-946815270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3.83dbc213-8c2a-45c9-aed9-c1f61cfbf953 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:56 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3.83dbc213-8c2a-45c9-aed9-c1f61cfbf953 Sep 28 18:16:56 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:56 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-15c22aba-eab7-44df-8236-65f15a14175b tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.583s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:56 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-15c22aba-eab7-44df-8236-65f15a14175b tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:16:56 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-15c22aba-eab7-44df-8236-65f15a14175b tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Deleted volume successfully. Sep 28 18:16:56 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-15c22aba-eab7-44df-8236-65f15a14175b tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "cinder-ebaaa04a-21c2-4ff6-ae89-ac2d5e6cbd45-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:57 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a23463fd-ab12-49b2-baf8-f3a7e3b39b9d tempest-GroupSnapshotsV319Test-946815270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3.83dbc213-8c2a-45c9-aed9-c1f61cfbf953" returned: 0 in 0.594s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:57 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1c540b85-41c6-4732-850b-497f3469db81 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "cinder-40e71847-8bb7-496b-9c0b-ef47c37fac52-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:57 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1c540b85-41c6-4732-850b-497f3469db81 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "cinder-40e71847-8bb7-496b-9c0b-ef47c37fac52-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a23463fd-ab12-49b2-baf8-f3a7e3b39b9d tempest-GroupSnapshotsV319Test-946815270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:57 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3.info Sep 28 18:16:57 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:57 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1c540b85-41c6-4732-850b-497f3469db81 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "cinder-quobyte-40e71847-8bb7-496b-9c0b-ef47c37fac52" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:57 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1c540b85-41c6-4732-850b-497f3469db81 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "cinder-quobyte-40e71847-8bb7-496b-9c0b-ef47c37fac52" acquired by "delete_volume" :: waited 0.024s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:57 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f57edb-6950-4023-a834-6593d55f1691]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1c540b85-41c6-4732-850b-497f3469db81 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-40e71847-8bb7-496b-9c0b-ef47c37fac52 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:57 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-40e71847-8bb7-496b-9c0b-ef47c37fac52 Sep 28 18:16:57 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:57 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a23463fd-ab12-49b2-baf8-f3a7e3b39b9d tempest-GroupSnapshotsV319Test-946815270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3.info" returned: 0 in 0.477s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:57 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-a23463fd-ab12-49b2-baf8-f3a7e3b39b9d tempest-GroupSnapshotsV319Test-946815270 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:16:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a23463fd-ab12-49b2-baf8-f3a7e3b39b9d tempest-GroupSnapshotsV319Test-946815270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:57 devstack sudo[100776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3.info Sep 28 18:16:57 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:57 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1c540b85-41c6-4732-850b-497f3469db81 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-40e71847-8bb7-496b-9c0b-ef47c37fac52" returned: 0 in 0.538s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1c540b85-41c6-4732-850b-497f3469db81 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-40e71847-8bb7-496b-9c0b-ef47c37fac52 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:57 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-40e71847-8bb7-496b-9c0b-ef47c37fac52 Sep 28 18:16:57 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:58 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a23463fd-ab12-49b2-baf8-f3a7e3b39b9d tempest-GroupSnapshotsV319Test-946815270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3.info" returned: 0 in 0.432s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a23463fd-ab12-49b2-baf8-f3a7e3b39b9d tempest-GroupSnapshotsV319Test-946815270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.824s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:58 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1c540b85-41c6-4732-850b-497f3469db81 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-40e71847-8bb7-496b-9c0b-ef47c37fac52" returned: 0 in 0.353s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:58 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1c540b85-41c6-4732-850b-497f3469db81 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "cinder-quobyte-40e71847-8bb7-496b-9c0b-ef47c37fac52" released by "delete_volume" :: held 0.957s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:58 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-a23463fd-ab12-49b2-baf8-f3a7e3b39b9d tempest-GroupSnapshotsV319Test-946815270 None] group_snapshot 504132c6-1db6-4e12-9edf-6b4b28631e6a: created successfully Sep 28 18:16:58 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-1c540b85-41c6-4732-850b-497f3469db81 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Created reservations ['7a30466e-f0eb-4717-bd24-bc16bc83347c', '3395fd5a-046f-43c8-871b-bf2e2755320d', '09d9e441-4b5c-44c5-be8e-aee812e4e1c6', 'c1a17b1a-9d3d-448e-b48c-17f5480ea27f'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:16:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1c540b85-41c6-4732-850b-497f3469db81 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:16:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1c540b85-41c6-4732-850b-497f3469db81 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:16:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1c540b85-41c6-4732-850b-497f3469db81 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:16:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1c540b85-41c6-4732-850b-497f3469db81 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:16:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1c540b85-41c6-4732-850b-497f3469db81 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:16:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1c540b85-41c6-4732-850b-497f3469db81 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:58 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:16:58 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:16:58 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Sep 28 18:16:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1c540b85-41c6-4732-850b-497f3469db81 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.367s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:16:58 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-1c540b85-41c6-4732-850b-497f3469db81 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:16:58 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-1c540b85-41c6-4732-850b-497f3469db81 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Deleted volume successfully. Sep 28 18:16:58 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1c540b85-41c6-4732-850b-497f3469db81 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "cinder-40e71847-8bb7-496b-9c0b-ef47c37fac52-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:16:59 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-9b5c8144-d13d-4863-ba34-b0fac37948ee tempest-GroupSnapshotsV319Test-946815270 None] group_snapshot 504132c6-1db6-4e12-9edf-6b4b28631e6a: deleting Sep 28 18:16:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9b5c8144-d13d-4863-ba34-b0fac37948ee tempest-GroupSnapshotsV319Test-946815270 None] group_snapshot 504132c6-1db6-4e12-9edf-6b4b28631e6a: deleting {{(pid=86980) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 18:16:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9b5c8144-d13d-4863-ba34-b0fac37948ee tempest-GroupSnapshotsV319Test-946815270 None] Acquiring lock "cinder-quobyte-2d24de28-750b-44ec-b671-62a461bd1ee3" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9b5c8144-d13d-4863-ba34-b0fac37948ee tempest-GroupSnapshotsV319Test-946815270 None] Lock "cinder-quobyte-2d24de28-750b-44ec-b671-62a461bd1ee3" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9b5c8144-d13d-4863-ba34-b0fac37948ee tempest-GroupSnapshotsV319Test-946815270 None] Acquiring lock "cinder-quobyte-83dbc213-8c2a-45c9-aed9-c1f61cfbf953" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9b5c8144-d13d-4863-ba34-b0fac37948ee tempest-GroupSnapshotsV319Test-946815270 None] Lock "cinder-quobyte-83dbc213-8c2a-45c9-aed9-c1f61cfbf953" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-9b5c8144-d13d-4863-ba34-b0fac37948ee tempest-GroupSnapshotsV319Test-946815270 None] Deleting offline snapshot 83dbc213-8c2a-45c9-aed9-c1f61cfbf953 of volume 2d24de28-750b-44ec-b671-62a461bd1ee3 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:16:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-9b5c8144-d13d-4863-ba34-b0fac37948ee tempest-GroupSnapshotsV319Test-946815270 None] snapshot_file for this snap is: volume-2d24de28-750b-44ec-b671-62a461bd1ee3.83dbc213-8c2a-45c9-aed9-c1f61cfbf953 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:16:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5df22a37-1e97-40b6-8850-0ce2eb444279 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "cinder-77d71cfa-68f0-4a1a-845c-fa1464447b30-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:59 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b61ffe1-d089-4b23-8e70-cbb8aa1537bd]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9b5c8144-d13d-4863-ba34-b0fac37948ee tempest-GroupSnapshotsV319Test-946815270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3.83dbc213-8c2a-45c9-aed9-c1f61cfbf953 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5df22a37-1e97-40b6-8850-0ce2eb444279 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "cinder-77d71cfa-68f0-4a1a-845c-fa1464447b30-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5df22a37-1e97-40b6-8850-0ce2eb444279 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "cinder-quobyte-77d71cfa-68f0-4a1a-845c-fa1464447b30" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:16:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5df22a37-1e97-40b6-8850-0ce2eb444279 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "cinder-quobyte-77d71cfa-68f0-4a1a-845c-fa1464447b30" acquired by "delete_volume" :: waited 0.047s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:16:59 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c9cc5c-855d-4e6b-859d-844ee28fee60]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:16:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5df22a37-1e97-40b6-8850-0ce2eb444279 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-77d71cfa-68f0-4a1a-845c-fa1464447b30 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:16:59 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3.83dbc213-8c2a-45c9-aed9-c1f61cfbf953 Sep 28 18:16:59 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:00 devstack sudo[100795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-77d71cfa-68f0-4a1a-845c-fa1464447b30 Sep 28 18:17:00 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:00 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9b5c8144-d13d-4863-ba34-b0fac37948ee tempest-GroupSnapshotsV319Test-946815270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3.83dbc213-8c2a-45c9-aed9-c1f61cfbf953" returned: 0 in 0.874s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-9b5c8144-d13d-4863-ba34-b0fac37948ee tempest-GroupSnapshotsV319Test-946815270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d24de28-750b-44ec-b671-62a461bd1ee3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:17:00 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5df22a37-1e97-40b6-8850-0ce2eb444279 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-77d71cfa-68f0-4a1a-845c-fa1464447b30" returned: 0 in 0.581s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5df22a37-1e97-40b6-8850-0ce2eb444279 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-77d71cfa-68f0-4a1a-845c-fa1464447b30 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:00 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1ddb69-7f22-4515-8c38-2bb77e0b3d95]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:17:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9b5c8144-d13d-4863-ba34-b0fac37948ee tempest-GroupSnapshotsV319Test-946815270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:00 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-77d71cfa-68f0-4a1a-845c-fa1464447b30 Sep 28 18:17:00 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:00 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3 Sep 28 18:17:00 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:00 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5df22a37-1e97-40b6-8850-0ce2eb444279 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-77d71cfa-68f0-4a1a-845c-fa1464447b30" returned: 0 in 0.478s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5df22a37-1e97-40b6-8850-0ce2eb444279 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "cinder-quobyte-77d71cfa-68f0-4a1a-845c-fa1464447b30" released by "delete_volume" :: held 1.195s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:01 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-5df22a37-1e97-40b6-8850-0ce2eb444279 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Created reservations ['b6b221c7-15b9-45d3-b351-2d47a06f0c77', '35337ca7-c43c-4874-8d4e-cac7b256c5a9', '7698a9a0-711d-4c14-a1f5-7afeb7445bb0', '49b8abee-00e1-472a-8879-3cce7066d073'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:17:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5df22a37-1e97-40b6-8850-0ce2eb444279 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5df22a37-1e97-40b6-8850-0ce2eb444279 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-5df22a37-1e97-40b6-8850-0ce2eb444279 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-5df22a37-1e97-40b6-8850-0ce2eb444279 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5df22a37-1e97-40b6-8850-0ce2eb444279 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5df22a37-1e97-40b6-8850-0ce2eb444279 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:01 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9b5c8144-d13d-4863-ba34-b0fac37948ee tempest-GroupSnapshotsV319Test-946815270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3" returned: 0 in 0.827s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9b5c8144-d13d-4863-ba34-b0fac37948ee tempest-GroupSnapshotsV319Test-946815270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3.83dbc213-8c2a-45c9-aed9-c1f61cfbf953 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:01 devstack sudo[100814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:17:01 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:01 devstack sudo[100815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3.83dbc213-8c2a-45c9-aed9-c1f61cfbf953 Sep 28 18:17:01 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:01 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5df22a37-1e97-40b6-8850-0ce2eb444279 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.410s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:01 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-5df22a37-1e97-40b6-8850-0ce2eb444279 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:17:01 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-5df22a37-1e97-40b6-8850-0ce2eb444279 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Deleted volume successfully. Sep 28 18:17:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5df22a37-1e97-40b6-8850-0ce2eb444279 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "cinder-77d71cfa-68f0-4a1a-845c-fa1464447b30-delete_volume" released by "delete_volume" :: held 2.172s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:01 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9b5c8144-d13d-4863-ba34-b0fac37948ee tempest-GroupSnapshotsV319Test-946815270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3.83dbc213-8c2a-45c9-aed9-c1f61cfbf953" returned: 0 in 0.710s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9b5c8144-d13d-4863-ba34-b0fac37948ee tempest-GroupSnapshotsV319Test-946815270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3.83dbc213-8c2a-45c9-aed9-c1f61cfbf953 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:02 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3.83dbc213-8c2a-45c9-aed9-c1f61cfbf953 Sep 28 18:17:02 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:02 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f907a582-a4bd-4708-bdff-a0a2c1dd2743 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "cinder-48fe7ad9-83a9-46df-b8b4-fe020f0ddea1-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:02 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f907a582-a4bd-4708-bdff-a0a2c1dd2743 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "cinder-48fe7ad9-83a9-46df-b8b4-fe020f0ddea1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:02 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f907a582-a4bd-4708-bdff-a0a2c1dd2743 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "cinder-quobyte-48fe7ad9-83a9-46df-b8b4-fe020f0ddea1" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:02 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f907a582-a4bd-4708-bdff-a0a2c1dd2743 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "cinder-quobyte-48fe7ad9-83a9-46df-b8b4-fe020f0ddea1" acquired by "delete_volume" :: waited 0.033s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:02 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a545851-17b8-461b-a778-579c004550dc]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:17:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f907a582-a4bd-4708-bdff-a0a2c1dd2743 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-48fe7ad9-83a9-46df-b8b4-fe020f0ddea1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:02 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-48fe7ad9-83a9-46df-b8b4-fe020f0ddea1 Sep 28 18:17:02 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:02 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9b5c8144-d13d-4863-ba34-b0fac37948ee tempest-GroupSnapshotsV319Test-946815270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3.83dbc213-8c2a-45c9-aed9-c1f61cfbf953" returned: 0 in 0.598s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:02 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9b5c8144-d13d-4863-ba34-b0fac37948ee tempest-GroupSnapshotsV319Test-946815270 None] Lock "cinder-quobyte-83dbc213-8c2a-45c9-aed9-c1f61cfbf953" released by "_delete_snapshot" :: held 3.316s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:02 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9b5c8144-d13d-4863-ba34-b0fac37948ee tempest-GroupSnapshotsV319Test-946815270 None] Lock "cinder-quobyte-2d24de28-750b-44ec-b671-62a461bd1ee3" released by "delete_snapshot" :: held 3.356s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:02 devstack cinder-volume[86980]: WARNING cinder.quota [None req-9b5c8144-d13d-4863-ba34-b0fac37948ee tempest-GroupSnapshotsV319Test-946815270 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-204696028 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-204696028, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:17:02 devstack cinder-volume[86980]: WARNING cinder.quota [None req-9b5c8144-d13d-4863-ba34-b0fac37948ee tempest-GroupSnapshotsV319Test-946815270 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-204696028 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-204696028, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:17:02 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-9b5c8144-d13d-4863-ba34-b0fac37948ee tempest-GroupSnapshotsV319Test-946815270 None] Created reservations ['b08a044b-df65-4452-bd91-83823f9827e6', '378533d9-6ada-4d6d-9216-77dc362d010b', '5776f09c-96fc-4054-9d48-6cc5f78ff826', 'a7c62f68-2b36-41dc-9c0a-ad6ef1f67002'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:17:03 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f907a582-a4bd-4708-bdff-a0a2c1dd2743 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-48fe7ad9-83a9-46df-b8b4-fe020f0ddea1" returned: 0 in 0.754s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f907a582-a4bd-4708-bdff-a0a2c1dd2743 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-48fe7ad9-83a9-46df-b8b4-fe020f0ddea1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:03 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-48fe7ad9-83a9-46df-b8b4-fe020f0ddea1 Sep 28 18:17:03 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:03 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-9b5c8144-d13d-4863-ba34-b0fac37948ee tempest-GroupSnapshotsV319Test-946815270 None] group_snapshot 504132c6-1db6-4e12-9edf-6b4b28631e6a: deleted successfully Sep 28 18:17:03 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f907a582-a4bd-4708-bdff-a0a2c1dd2743 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-48fe7ad9-83a9-46df-b8b4-fe020f0ddea1" returned: 0 in 0.422s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:03 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f907a582-a4bd-4708-bdff-a0a2c1dd2743 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "cinder-quobyte-48fe7ad9-83a9-46df-b8b4-fe020f0ddea1" released by "delete_volume" :: held 1.284s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:03 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-f907a582-a4bd-4708-bdff-a0a2c1dd2743 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Created reservations ['21d95d3a-4e93-402e-b4a0-2f3a6ffa92ce', '07a8e046-8d5d-4169-ab35-f69593b102e2', 'fb0c2316-1390-45ca-85bc-5329d1c137fc', '7ba2722c-1889-4f4a-bb44-448375ea761a'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:17:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f907a582-a4bd-4708-bdff-a0a2c1dd2743 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f907a582-a4bd-4708-bdff-a0a2c1dd2743 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f907a582-a4bd-4708-bdff-a0a2c1dd2743 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f907a582-a4bd-4708-bdff-a0a2c1dd2743 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f907a582-a4bd-4708-bdff-a0a2c1dd2743 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f907a582-a4bd-4708-bdff-a0a2c1dd2743 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:03 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:17:03 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:04 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:17:04 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:17:04 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Flow 'volume_create_manager' (4471a62c-9c94-4dee-879a-ad1fed001d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6418d745-5c65-423c-b832-568ac4ec4b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f907a582-a4bd-4708-bdff-a0a2c1dd2743 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.981s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-f907a582-a4bd-4708-bdff-a0a2c1dd2743 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0d15184c-cbde-448e-9f18-0f17e93648cd tempest-GroupSnapshotsV319Test-946815270 None] Acquiring lock "cinder-quobyte-2d24de28-750b-44ec-b671-62a461bd1ee3" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:04 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-f907a582-a4bd-4708-bdff-a0a2c1dd2743 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Deleted volume successfully. Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6418d745-5c65-423c-b832-568ac4ec4b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1707203440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29cf397a-4c10-4e3b-99cf-e65674c29b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ceaec1971345ad9cefaef3cf9e0850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:04Z,use_quota=True,user_id='4e9c1bb81b0c4c5f91377dbb686a0d84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (845b60bc-dd25-4a21-b56f-4b8d75a43467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (845b60bc-dd25-4a21-b56f-4b8d75a43467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d79ab9-c08c-4f7d-8128-6719d128f48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d79ab9-c08c-4f7d-8128-6719d128f48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29cf397a-4c10-4e3b-99cf-e65674c29b10', 'volume_name': 'volume-29cf397a-4c10-4e3b-99cf-e65674c29b10', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b3b7559-4af3-48fe-a484-f2b905394501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b3b7559-4af3-48fe-a484-f2b905394501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c7a354-c586-4fb8-83a8-1c4b3f1560a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:04 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Volume 29cf397a-4c10-4e3b-99cf-e65674c29b10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29cf397a-4c10-4e3b-99cf-e65674c29b10', 'volume_size': 1} Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1707203440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29cf397a-4c10-4e3b-99cf-e65674c29b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ceaec1971345ad9cefaef3cf9e0850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:04Z,use_quota=True,user_id='4e9c1bb81b0c4c5f91377dbb686a0d84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Creating volume 29cf397a-4c10-4e3b-99cf-e65674c29b10 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:17:04 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:17:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-29cf397a-4c10-4e3b-99cf-e65674c29b10 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:04 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:04 devstack sudo[100843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-29cf397a-4c10-4e3b-99cf-e65674c29b10 1073741824 Sep 28 18:17:04 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0d15184c-cbde-448e-9f18-0f17e93648cd tempest-GroupSnapshotsV319Test-946815270 None] Lock "cinder-quobyte-2d24de28-750b-44ec-b671-62a461bd1ee3" acquired by "delete_volume" :: waited 0.200s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.499s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:05 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:17:05 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager._thread_info {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:17:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread count: 28 {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:17:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread info: [<_MainThread(MainThread, started 129097393381504)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:17:05 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa84a5d-5715-4b01-b869-eed63e479732]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:17:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f907a582-a4bd-4708-bdff-a0a2c1dd2743 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "cinder-48fe7ad9-83a9-46df-b8b4-fe020f0ddea1-delete_volume" released by "delete_volume" :: held 3.060s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0d15184c-cbde-448e-9f18-0f17e93648cd tempest-GroupSnapshotsV319Test-946815270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-577be913-a614-4e0e-8c30-b94848fbd8d8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "cinder-3de0aab7-a138-47eb-ab61-195f23bfa715-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-577be913-a614-4e0e-8c30-b94848fbd8d8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "cinder-3de0aab7-a138-47eb-ab61-195f23bfa715-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-577be913-a614-4e0e-8c30-b94848fbd8d8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "cinder-quobyte-3de0aab7-a138-47eb-ab61-195f23bfa715" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-577be913-a614-4e0e-8c30-b94848fbd8d8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "cinder-quobyte-3de0aab7-a138-47eb-ab61-195f23bfa715" acquired by "delete_volume" :: waited 0.051s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:05 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee23e88-fe12-412f-b4e6-b7676d193c51]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:17:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-577be913-a614-4e0e-8c30-b94848fbd8d8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3de0aab7-a138-47eb-ab61-195f23bfa715 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:05 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3 Sep 28 18:17:05 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:05 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:17:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Flow 'volume_create_manager' (953c7788-e911-4cf2-b21a-be49e2789845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (240cfbc5-8900-4fca-93b3-424b92a0aaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:05 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3de0aab7-a138-47eb-ab61-195f23bfa715 Sep 28 18:17:05 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (240cfbc5-8900-4fca-93b3-424b92a0aaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2086689144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2afc0a26-cca9-4d9d-a32f-b4ec74cceb2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ceaec1971345ad9cefaef3cf9e0850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:06Z,use_quota=True,user_id='4e9c1bb81b0c4c5f91377dbb686a0d84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73348b0c-82e6-4a3b-8cd9-c9cc08cd95ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73348b0c-82e6-4a3b-8cd9-c9cc08cd95ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b38ea4ec-14da-4b2c-ad42-84029ea03bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b38ea4ec-14da-4b2c-ad42-84029ea03bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2afc0a26-cca9-4d9d-a32f-b4ec74cceb2e', 'volume_name': 'volume-2afc0a26-cca9-4d9d-a32f-b4ec74cceb2e', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c8bd72-0f8e-4fc8-a3f8-8854b0b27832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c8bd72-0f8e-4fc8-a3f8-8854b0b27832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ed2d05-8ea0-487c-b8de-f4aa78432d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:05 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Volume 2afc0a26-cca9-4d9d-a32f-b4ec74cceb2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2afc0a26-cca9-4d9d-a32f-b4ec74cceb2e', 'volume_size': 1} Sep 28 18:17:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:05 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-29cf397a-4c10-4e3b-99cf-e65674c29b10 1073741824" returned: 0 in 1.042s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-29cf397a-4c10-4e3b-99cf-e65674c29b10 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:06 devstack sudo[100855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-29cf397a-4c10-4e3b-99cf-e65674c29b10 Sep 28 18:17:06 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:06 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:06 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0d15184c-cbde-448e-9f18-0f17e93648cd tempest-GroupSnapshotsV319Test-946815270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3" returned: 0 in 1.010s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0d15184c-cbde-448e-9f18-0f17e93648cd tempest-GroupSnapshotsV319Test-946815270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-577be913-a614-4e0e-8c30-b94848fbd8d8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3de0aab7-a138-47eb-ab61-195f23bfa715" returned: 0 in 0.749s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-577be913-a614-4e0e-8c30-b94848fbd8d8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3de0aab7-a138-47eb-ab61-195f23bfa715 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:06 devstack sudo[100860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3 Sep 28 18:17:06 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:06 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3de0aab7-a138-47eb-ab61-195f23bfa715 Sep 28 18:17:06 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:06 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-29cf397a-4c10-4e3b-99cf-e65674c29b10" returned: 0 in 0.403s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:17:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.609s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2086689144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2afc0a26-cca9-4d9d-a32f-b4ec74cceb2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ceaec1971345ad9cefaef3cf9e0850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:06Z,use_quota=True,user_id='4e9c1bb81b0c4c5f91377dbb686a0d84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:17:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Creating volume 2afc0a26-cca9-4d9d-a32f-b4ec74cceb2e {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:17:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:17:06 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:17:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2afc0a26-cca9-4d9d-a32f-b4ec74cceb2e 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c7a354-c586-4fb8-83a8-1c4b3f1560a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29cf397a-4c10-4e3b-99cf-e65674c29b10', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:06 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2afc0a26-cca9-4d9d-a32f-b4ec74cceb2e 1073741824 Sep 28 18:17:06 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3deb3779-6b81-4e79-b397-e37373529fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:06 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Volume volume-29cf397a-4c10-4e3b-99cf-e65674c29b10 (29cf397a-4c10-4e3b-99cf-e65674c29b10): created successfully Sep 28 18:17:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3deb3779-6b81-4e79-b397-e37373529fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Flow 'volume_create_manager' (4471a62c-9c94-4dee-879a-ad1fed001d6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:06 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-347ee5a9-8f6b-4999-8112-77ecb6eec76f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Created volume successfully. Sep 28 18:17:06 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-577be913-a614-4e0e-8c30-b94848fbd8d8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3de0aab7-a138-47eb-ab61-195f23bfa715" returned: 0 in 0.554s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-577be913-a614-4e0e-8c30-b94848fbd8d8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "cinder-quobyte-3de0aab7-a138-47eb-ab61-195f23bfa715" released by "delete_volume" :: held 1.405s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:06 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-577be913-a614-4e0e-8c30-b94848fbd8d8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Created reservations ['49082a46-31c6-4c94-bc33-c192b7934bc8', 'a000a1dd-2b77-4e2a-a0c7-f8bdc45c413f', '25ced675-69f7-4a24-9598-4656953eff3f', 'cb06ee57-4adc-420e-a587-9b9352cc92f2'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:17:06 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0d15184c-cbde-448e-9f18-0f17e93648cd tempest-GroupSnapshotsV319Test-946815270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2d24de28-750b-44ec-b671-62a461bd1ee3" returned: 0 in 0.801s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:07 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0d15184c-cbde-448e-9f18-0f17e93648cd tempest-GroupSnapshotsV319Test-946815270 None] Lock "cinder-quobyte-2d24de28-750b-44ec-b671-62a461bd1ee3" released by "delete_volume" :: held 2.046s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-577be913-a614-4e0e-8c30-b94848fbd8d8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-577be913-a614-4e0e-8c30-b94848fbd8d8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-577be913-a614-4e0e-8c30-b94848fbd8d8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-577be913-a614-4e0e-8c30-b94848fbd8d8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-577be913-a614-4e0e-8c30-b94848fbd8d8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-577be913-a614-4e0e-8c30-b94848fbd8d8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:07 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-0d15184c-cbde-448e-9f18-0f17e93648cd tempest-GroupSnapshotsV319Test-946815270 None] Created reservations ['7d620548-9bac-402d-be05-6d0a8d7c02f5'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:17:07 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:17:07 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:07 devstack cinder-volume[86980]: WARNING cinder.quota [None req-0d15184c-cbde-448e-9f18-0f17e93648cd tempest-GroupSnapshotsV319Test-946815270 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-204696028 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-204696028, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:17:07 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-0d15184c-cbde-448e-9f18-0f17e93648cd tempest-GroupSnapshotsV319Test-946815270 None] Created reservations ['50cc0ec9-6204-47c7-b8d7-635c7c44ed6f', '04be897e-0656-41f9-a434-b84c830f4b77', 'a6787cde-a37f-4a82-bd2a-a42ce85f66fa', 'cc7417d4-9883-4706-80de-eb2af483c661'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:17:07 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2afc0a26-cca9-4d9d-a32f-b4ec74cceb2e 1073741824" returned: 0 in 0.911s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2afc0a26-cca9-4d9d-a32f-b4ec74cceb2e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:07 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2afc0a26-cca9-4d9d-a32f-b4ec74cceb2e Sep 28 18:17:07 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0d15184c-cbde-448e-9f18-0f17e93648cd tempest-GroupSnapshotsV319Test-946815270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0d15184c-cbde-448e-9f18-0f17e93648cd tempest-GroupSnapshotsV319Test-946815270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0d15184c-cbde-448e-9f18-0f17e93648cd tempest-GroupSnapshotsV319Test-946815270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0d15184c-cbde-448e-9f18-0f17e93648cd tempest-GroupSnapshotsV319Test-946815270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0d15184c-cbde-448e-9f18-0f17e93648cd tempest-GroupSnapshotsV319Test-946815270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0d15184c-cbde-448e-9f18-0f17e93648cd tempest-GroupSnapshotsV319Test-946815270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:07 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:17:07 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:08 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-577be913-a614-4e0e-8c30-b94848fbd8d8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.873s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:08 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-577be913-a614-4e0e-8c30-b94848fbd8d8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:17:08 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-577be913-a614-4e0e-8c30-b94848fbd8d8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Deleted volume successfully. Sep 28 18:17:08 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-577be913-a614-4e0e-8c30-b94848fbd8d8 tempest-CreateVolumesFromSourceVolumeTest-1440564458 None] Lock "cinder-3de0aab7-a138-47eb-ab61-195f23bfa715-delete_volume" released by "delete_volume" :: held 2.856s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:08 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2afc0a26-cca9-4d9d-a32f-b4ec74cceb2e" returned: 0 in 0.659s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:08 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:17:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ed2d05-8ea0-487c-b8de-f4aa78432d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2afc0a26-cca9-4d9d-a32f-b4ec74cceb2e', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a1789a-0ed4-4f64-9161-cc0583ea2524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:08 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Volume volume-2afc0a26-cca9-4d9d-a32f-b4ec74cceb2e (2afc0a26-cca9-4d9d-a32f-b4ec74cceb2e): created successfully Sep 28 18:17:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a1789a-0ed4-4f64-9161-cc0583ea2524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Flow 'volume_create_manager' (953c7788-e911-4cf2-b21a-be49e2789845) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:08 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-f59dc0d0-7986-49ee-9f3f-60d517a2efac tempest-TestServerVolumeAttachmentScenario-1055790954 None] Created volume successfully. Sep 28 18:17:08 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0d15184c-cbde-448e-9f18-0f17e93648cd tempest-GroupSnapshotsV319Test-946815270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.656s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:08 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-0d15184c-cbde-448e-9f18-0f17e93648cd tempest-GroupSnapshotsV319Test-946815270 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:17:08 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-0d15184c-cbde-448e-9f18-0f17e93648cd tempest-GroupSnapshotsV319Test-946815270 None] Delete group completed successfully. Sep 28 18:17:15 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:17:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Flow 'volume_create_manager' (e2213b13-7bbf-482e-90e8-51b56cbd9953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (516ff4a3-147b-4d0e-83e8-4c23b5ef97df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (516ff4a3-147b-4d0e-83e8-4c23b5ef97df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-259364274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d40c2cf1794ec9885cbb6f8ddbba2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:15Z,use_quota=True,user_id='5bb82ca549fd4e5d88aaf03fc77b86b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea5fd6a6-db79-4636-b66b-a9d2b927961c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea5fd6a6-db79-4636-b66b-a9d2b927961c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e4d1bf5-5387-481a-8e56-ba2dac22d195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e4d1bf5-5387-481a-8e56-ba2dac22d195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a', 'volume_name': 'volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264f19ff-c6ab-441b-a52c-5ccfc99263b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264f19ff-c6ab-441b-a52c-5ccfc99263b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a86a5cc-20d3-4f74-a6d0-debde41ac431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:15 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Volume 1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a', 'volume_size': 1} Sep 28 18:17:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:15 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-259364274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d40c2cf1794ec9885cbb6f8ddbba2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:15Z,use_quota=True,user_id='5bb82ca549fd4e5d88aaf03fc77b86b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:17:15 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Creating volume 1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:17:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:15 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:15 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:15 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:17:15 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:17:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:15 devstack sudo[100887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a 1073741824 Sep 28 18:17:15 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:16 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a 1073741824" returned: 0 in 1.000s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:16 devstack sudo[100892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a Sep 28 18:17:16 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:16 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a" returned: 0 in 0.392s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:17:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a86a5cc-20d3-4f74-a6d0-debde41ac431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4faaac-b0dd-4fac-b5d4-1b4905ea6415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:16 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Volume volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a (1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a): created successfully Sep 28 18:17:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4faaac-b0dd-4fac-b5d4-1b4905ea6415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Flow 'volume_create_manager' (e2213b13-7bbf-482e-90e8-51b56cbd9953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:17 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-5049cab7-ff36-4cc9-9e86-52dc7e5e0301 tempest-VolumeDependencyTests-1182238293 None] Created volume successfully. Sep 28 18:17:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-79cc1224-11e9-4548-8666-5f9226840f16 tempest-VolumeDependencyTests-1182238293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-79cc1224-11e9-4548-8666-5f9226840f16 tempest-VolumeDependencyTests-1182238293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-79cc1224-11e9-4548-8666-5f9226840f16 tempest-VolumeDependencyTests-1182238293 None] Creating offline snapshot f13f5b6c-ce99-4bf7-856d-79314f632538 of volume 1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:17:18 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f11b2b0-2c26-47ac-907e-028390c7f982]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:17:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-79cc1224-11e9-4548-8666-5f9226840f16 tempest-VolumeDependencyTests-1182238293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:18 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a Sep 28 18:17:18 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:18 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-79cc1224-11e9-4548-8666-5f9226840f16 tempest-VolumeDependencyTests-1182238293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a" returned: 0 in 0.586s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-79cc1224-11e9-4548-8666-5f9226840f16 tempest-VolumeDependencyTests-1182238293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.f13f5b6c-ce99-4bf7-856d-79314f632538 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:18 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.f13f5b6c-ce99-4bf7-856d-79314f632538 1G Sep 28 18:17:18 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:19 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-79cc1224-11e9-4548-8666-5f9226840f16 tempest-VolumeDependencyTests-1182238293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.f13f5b6c-ce99-4bf7-856d-79314f632538 1G" returned: 0 in 0.696s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-79cc1224-11e9-4548-8666-5f9226840f16 tempest-VolumeDependencyTests-1182238293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.f13f5b6c-ce99-4bf7-856d-79314f632538 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:19 devstack sudo[100922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.f13f5b6c-ce99-4bf7-856d-79314f632538 Sep 28 18:17:19 devstack sudo[100922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:19 devstack sudo[100922]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-79cc1224-11e9-4548-8666-5f9226840f16 tempest-VolumeDependencyTests-1182238293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.f13f5b6c-ce99-4bf7-856d-79314f632538" returned: 0 in 0.461s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:19 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-79cc1224-11e9-4548-8666-5f9226840f16 tempest-VolumeDependencyTests-1182238293 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.f13f5b6c-ce99-4bf7-856d-79314f632538 is being set with open permissions: ugo+rw Sep 28 18:17:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-79cc1224-11e9-4548-8666-5f9226840f16 tempest-VolumeDependencyTests-1182238293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.f13f5b6c-ce99-4bf7-856d-79314f632538 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:19 devstack sudo[100927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.f13f5b6c-ce99-4bf7-856d-79314f632538 Sep 28 18:17:19 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:20 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-79cc1224-11e9-4548-8666-5f9226840f16 tempest-VolumeDependencyTests-1182238293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.f13f5b6c-ce99-4bf7-856d-79314f632538" returned: 0 in 0.466s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-79cc1224-11e9-4548-8666-5f9226840f16 tempest-VolumeDependencyTests-1182238293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:20 devstack sudo[100930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.info Sep 28 18:17:20 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:20 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-79cc1224-11e9-4548-8666-5f9226840f16 tempest-VolumeDependencyTests-1182238293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.info" returned: 0 in 0.521s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:20 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-79cc1224-11e9-4548-8666-5f9226840f16 tempest-VolumeDependencyTests-1182238293 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.info is being set with open permissions: ugo+rw Sep 28 18:17:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-79cc1224-11e9-4548-8666-5f9226840f16 tempest-VolumeDependencyTests-1182238293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:20 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.info Sep 28 18:17:20 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:21 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-79cc1224-11e9-4548-8666-5f9226840f16 tempest-VolumeDependencyTests-1182238293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.info" returned: 0 in 0.386s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-79cc1224-11e9-4548-8666-5f9226840f16 tempest-VolumeDependencyTests-1182238293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.295s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:21 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-79cc1224-11e9-4548-8666-5f9226840f16 tempest-VolumeDependencyTests-1182238293 None] Create snapshot completed successfully Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Flow 'volume_create_manager' (11154021-f8a9-4750-8778-aed48e4f9da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d7b4fd-8679-440e-a45e-180eec24fff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d7b4fd-8679-440e-a45e-180eec24fff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-615841307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1575eb57-4197-4bf9-aa14-c49d3797a618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d40c2cf1794ec9885cbb6f8ddbba2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f13f5b6c-ce99-4bf7-856d-79314f632538,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:23Z,use_quota=True,user_id='5bb82ca549fd4e5d88aaf03fc77b86b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f465031-09ae-45cb-be38-069063a68c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f465031-09ae-45cb-be38-069063a68c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (573aeb08-040a-4422-843d-8145e25840ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (573aeb08-040a-4422-843d-8145e25840ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1575eb57-4197-4bf9-aa14-c49d3797a618', 'volume_name': 'volume-1575eb57-4197-4bf9-aa14-c49d3797a618', 'volume_size': 1, 'snapshot_id': 'f13f5b6c-ce99-4bf7-856d-79314f632538'}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2becf946-0c86-4182-a574-b8fd545fd01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2becf946-0c86-4182-a574-b8fd545fd01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0170f80-bae3-4fa3-bc25-0c70acf4c2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:23 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Volume 1575eb57-4197-4bf9-aa14-c49d3797a618: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1575eb57-4197-4bf9-aa14-c49d3797a618', 'volume_size': 1, 'snapshot_id': 'f13f5b6c-ce99-4bf7-856d-79314f632538'} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Acquiring lock "cinder-quobyte-f13f5b6c-ce99-4bf7-856d-79314f632538-1575eb57-4197-4bf9-aa14-c49d3797a618" by "_create_volume_from_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Lock "cinder-quobyte-f13f5b6c-ce99-4bf7-856d-79314f632538-1575eb57-4197-4bf9-aa14-c49d3797a618" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Creating volume 1575eb57-4197-4bf9-aa14-c49d3797a618 from snapshot f13f5b6c-ce99-4bf7-856d-79314f632538 {{(pid=86980) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Acquiring lock "cinder-quobyte-1575eb57-4197-4bf9-aa14-c49d3797a618" by "_copy_volume_from_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Lock "cinder-quobyte-1575eb57-4197-4bf9-aa14-c49d3797a618" acquired by "_copy_volume_from_snapshot" :: waited 0.061s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] snapshot: f13f5b6c-ce99-4bf7-856d-79314f632538, volume: 1575eb57-4197-4bf9-aa14-c49d3797a618, {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[194d93d8-f25c-4916-aaa5-1222e018b465]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:17:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.f13f5b6c-ce99-4bf7-856d-79314f632538 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:23 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.f13f5b6c-ce99-4bf7-856d-79314f632538 Sep 28 18:17:23 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:24 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:17:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Flow 'volume_create_manager' (6b5bbbd8-80e4-4434-abcb-fc8d3ba39488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d574d594-6857-4d56-85ae-d8bebbe8ccc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d574d594-6857-4d56-85ae-d8bebbe8ccc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1065170120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efce1114-fb8b-4590-9b8d-8b0522b3c4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e6100822814b9d9a9c80f8b9b7c444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:24Z,use_quota=True,user_id='f133e45a5bce4954be423e588f9c06b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (837bb137-fa76-4a57-8e5a-511fca669e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (837bb137-fa76-4a57-8e5a-511fca669e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f1bd3f-de27-4260-820f-5a6499cd0181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:24 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f1bd3f-de27-4260-820f-5a6499cd0181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efce1114-fb8b-4590-9b8d-8b0522b3c4d9', 'volume_name': 'volume-efce1114-fb8b-4590-9b8d-8b0522b3c4d9', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b4a8f6-7e4d-49b7-b980-3391327aa2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b4a8f6-7e4d-49b7-b980-3391327aa2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b652d01-4f40-439b-aea8-35d1ea983142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:24 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Volume efce1114-fb8b-4590-9b8d-8b0522b3c4d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efce1114-fb8b-4590-9b8d-8b0522b3c4d9', 'volume_size': 1} Sep 28 18:17:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.f13f5b6c-ce99-4bf7-856d-79314f632538" returned: 0 in 0.745s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:24 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:17:24 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2debeffa-6179-475f-9822-5b336b8f567f]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:17:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:24 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a Sep 28 18:17:24 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:25 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a" returned: 0 in 0.611s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:25 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:17:25 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Creating direct copy from snapshot {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:17:25 devstack cinder-volume[86980]: DEBUG cinder.utils [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Path /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1575eb57-4197-4bf9-aa14-c49d3797a618 not found in is_blk_device check {{(pid=86980) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:17:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1575eb57-4197-4bf9-aa14-c49d3797a618 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:25 devstack sudo[100948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1575eb57-4197-4bf9-aa14-c49d3797a618 Sep 28 18:17:25 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:34 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=82,cinder:INSERT=27,cinder:UPDATE=93,cinder:DELETE=6 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:17:34 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=75,cinder:UPDATE=107,cinder:DELETE=11,cinder:INSERT=18 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:17:35 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-812cfc93-0153-4467-995e-b96ee402fabc tempest-GroupsV314Test-970195440 None] Group tempest-GroupsV314Test-Group-685813670: creating Sep 28 18:17:35 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-812cfc93-0153-4467-995e-b96ee402fabc tempest-GroupsV314Test-970195440 None] Group tempest-GroupsV314Test-Group-685813670: created successfully Sep 28 18:17:35 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-812cfc93-0153-4467-995e-b96ee402fabc tempest-GroupsV314Test-970195440 None] Create group completed successfully. Sep 28 18:17:36 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1575eb57-4197-4bf9-aa14-c49d3797a618" returned: 0 in 11.576s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:36 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Image conversion details: src /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a, size 1024.00 MB, duration 11.58 sec, destination /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1575eb57-4197-4bf9-aa14-c49d3797a618 {{(pid=86980) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:17:36 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Converted 1024.00 MB image at 88.45 MB/s Sep 28 18:17:36 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1575eb57-4197-4bf9-aa14-c49d3797a618 is being set with open permissions: ugo+rw Sep 28 18:17:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1575eb57-4197-4bf9-aa14-c49d3797a618 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:36 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1575eb57-4197-4bf9-aa14-c49d3797a618 Sep 28 18:17:36 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:37 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1575eb57-4197-4bf9-aa14-c49d3797a618" returned: 0 in 0.280s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Lock "cinder-quobyte-1575eb57-4197-4bf9-aa14-c49d3797a618" released by "_copy_volume_from_snapshot" :: held 13.393s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Lock "cinder-quobyte-f13f5b6c-ce99-4bf7-856d-79314f632538-1575eb57-4197-4bf9-aa14-c49d3797a618" released by "_create_volume_from_snapshot" :: held 13.536s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.576s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.583s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1065170120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efce1114-fb8b-4590-9b8d-8b0522b3c4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e6100822814b9d9a9c80f8b9b7c444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:24Z,use_quota=True,user_id='f133e45a5bce4954be423e588f9c06b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Creating volume efce1114-fb8b-4590-9b8d-8b0522b3c4d9 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:17:37 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-efce1114-fb8b-4590-9b8d-8b0522b3c4d9 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:37 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-efce1114-fb8b-4590-9b8d-8b0522b3c4d9 1073741824 Sep 28 18:17:37 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0170f80-bae3-4fa3-bc25-0c70acf4c2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1575eb57-4197-4bf9-aa14-c49d3797a618', 'volume_size': 1, 'snapshot_id': 'f13f5b6c-ce99-4bf7-856d-79314f632538'}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b1c6c7-f822-4829-8eec-548898c04ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:37 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Volume volume-1575eb57-4197-4bf9-aa14-c49d3797a618 (1575eb57-4197-4bf9-aa14-c49d3797a618): created successfully Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b1c6c7-f822-4829-8eec-548898c04ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Flow 'volume_create_manager' (11154021-f8a9-4750-8778-aed48e4f9da3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:37 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-1b1fe892-4fcf-46e3-b52d-fc0b2a2adf93 tempest-VolumeDependencyTests-1182238293 None] Created volume successfully. Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-00140377-29e8-4a0a-9196-4550e502b771 tempest-VolumeDependencyTests-1182238293 None] Acquiring lock "cinder-f13f5b6c-ce99-4bf7-856d-79314f632538-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-00140377-29e8-4a0a-9196-4550e502b771 tempest-VolumeDependencyTests-1182238293 None] Lock "cinder-f13f5b6c-ce99-4bf7-856d-79314f632538-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-00140377-29e8-4a0a-9196-4550e502b771 tempest-VolumeDependencyTests-1182238293 None] Acquiring lock "cinder-quobyte-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-00140377-29e8-4a0a-9196-4550e502b771 tempest-VolumeDependencyTests-1182238293 None] Lock "cinder-quobyte-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-00140377-29e8-4a0a-9196-4550e502b771 tempest-VolumeDependencyTests-1182238293 None] Acquiring lock "cinder-quobyte-f13f5b6c-ce99-4bf7-856d-79314f632538" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-00140377-29e8-4a0a-9196-4550e502b771 tempest-VolumeDependencyTests-1182238293 None] Lock "cinder-quobyte-f13f5b6c-ce99-4bf7-856d-79314f632538" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-00140377-29e8-4a0a-9196-4550e502b771 tempest-VolumeDependencyTests-1182238293 None] Deleting offline snapshot f13f5b6c-ce99-4bf7-856d-79314f632538 of volume 1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-00140377-29e8-4a0a-9196-4550e502b771 tempest-VolumeDependencyTests-1182238293 None] snapshot_file for this snap is: volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.f13f5b6c-ce99-4bf7-856d-79314f632538 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bccdee-5749-4389-a0b5-f81d99126ec9]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-00140377-29e8-4a0a-9196-4550e502b771 tempest-VolumeDependencyTests-1182238293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.f13f5b6c-ce99-4bf7-856d-79314f632538 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Flow 'volume_create_manager' (868fa267-19d0-4e07-9a71-01bec85baa89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c02e390a-db9f-45d5-a011-fafb5685062e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:37 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.f13f5b6c-ce99-4bf7-856d-79314f632538 Sep 28 18:17:37 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c02e390a-db9f-45d5-a011-fafb5685062e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1579727409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=93f08157-abb5-4205-a10f-3e33181f89fa,host='devstack@QuobyteHD#QuobyteHD',id=6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e154d1389ae34f3f9032c0e0d9a2f41e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:38Z,use_quota=True,user_id='13d897d5246a4083b74ae4fcf8a403d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903bea26-be36-4667-aa34-81ec16e443c9),volume_type_id=903bea26-be36-4667-aa34-81ec16e443c9)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b219408-8e7a-4f93-85ba-b140481cfff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:38 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b219408-8e7a-4f93-85ba-b140481cfff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e9cf2c7-d458-430d-94d3-f1bceb09329f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e9cf2c7-d458-430d-94d3-f1bceb09329f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16', 'volume_name': 'volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8869117-27d0-4fd4-9470-5384067ed478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8869117-27d0-4fd4-9470-5384067ed478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c71b337-b2a8-4944-abb7-7256138c4fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:38 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Volume 6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16', 'volume_size': 1} Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-efce1114-fb8b-4590-9b8d-8b0522b3c4d9 1073741824" returned: 0 in 0.988s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-efce1114-fb8b-4590-9b8d-8b0522b3c4d9 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:38 devstack sudo[101061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-efce1114-fb8b-4590-9b8d-8b0522b3c4d9 Sep 28 18:17:38 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:38 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-00140377-29e8-4a0a-9196-4550e502b771 tempest-VolumeDependencyTests-1182238293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.f13f5b6c-ce99-4bf7-856d-79314f632538" returned: 0 in 0.640s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-00140377-29e8-4a0a-9196-4550e502b771 tempest-VolumeDependencyTests-1182238293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e895cb7-d25b-43be-9928-7b6aafd9b927]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-00140377-29e8-4a0a-9196-4550e502b771 tempest-VolumeDependencyTests-1182238293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:38 devstack sudo[101066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a Sep 28 18:17:38 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:38 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-efce1114-fb8b-4590-9b8d-8b0522b3c4d9" returned: 0 in 0.469s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.530s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=93f08157-abb5-4205-a10f-3e33181f89fa,created_at=2026-09-28T16:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1579727409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=93f08157-abb5-4205-a10f-3e33181f89fa,host='devstack@QuobyteHD#QuobyteHD',id=6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e154d1389ae34f3f9032c0e0d9a2f41e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:17:38Z,use_quota=True,user_id='13d897d5246a4083b74ae4fcf8a403d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903bea26-be36-4667-aa34-81ec16e443c9),volume_type_id=903bea26-be36-4667-aa34-81ec16e443c9)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Creating volume 6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:17:38 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:38 devstack sudo[101069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16 1073741824 Sep 28 18:17:38 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b652d01-4f40-439b-aea8-35d1ea983142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efce1114-fb8b-4590-9b8d-8b0522b3c4d9', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (911829fe-f806-404d-b508-390fd1a20714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:39 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Volume volume-efce1114-fb8b-4590-9b8d-8b0522b3c4d9 (efce1114-fb8b-4590-9b8d-8b0522b3c4d9): created successfully Sep 28 18:17:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (911829fe-f806-404d-b508-390fd1a20714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:39 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Flow 'volume_create_manager' (6b5bbbd8-80e4-4434-abcb-fc8d3ba39488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-00140377-29e8-4a0a-9196-4550e502b771 tempest-VolumeDependencyTests-1182238293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a" returned: 0 in 0.690s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-00140377-29e8-4a0a-9196-4550e502b771 tempest-VolumeDependencyTests-1182238293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.f13f5b6c-ce99-4bf7-856d-79314f632538 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:39 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:39 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-1711ee55-a163-4bd2-a196-88d648e38d94 tempest-TestImageHashVerification-748875059 None] Created volume successfully. Sep 28 18:17:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16 1073741824" returned: 0 in 0.559s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:39 devstack sudo[101079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.f13f5b6c-ce99-4bf7-856d-79314f632538 Sep 28 18:17:39 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:39 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16 Sep 28 18:17:39 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:39 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16" returned: 0 in 0.354s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:17:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:39 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-00140377-29e8-4a0a-9196-4550e502b771 tempest-VolumeDependencyTests-1182238293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.f13f5b6c-ce99-4bf7-856d-79314f632538" returned: 0 in 0.479s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-00140377-29e8-4a0a-9196-4550e502b771 tempest-VolumeDependencyTests-1182238293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.f13f5b6c-ce99-4bf7-856d-79314f632538 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c71b337-b2a8-4944-abb7-7256138c4fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:39 devstack sudo[101087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.f13f5b6c-ce99-4bf7-856d-79314f632538 Sep 28 18:17:39 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c2bcfd2-f180-4dfd-aec6-745000690b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:17:39 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Volume volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16 (6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16): created successfully Sep 28 18:17:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c2bcfd2-f180-4dfd-aec6-745000690b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:17:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Flow 'volume_create_manager' (868fa267-19d0-4e07-9a71-01bec85baa89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:17:39 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-35a511ec-57a5-4f23-aa6c-e4d9c5c28f15 tempest-GroupsV314Test-970195440 None] Created volume successfully. Sep 28 18:17:40 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-00140377-29e8-4a0a-9196-4550e502b771 tempest-VolumeDependencyTests-1182238293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a.f13f5b6c-ce99-4bf7-856d-79314f632538" returned: 0 in 0.433s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-00140377-29e8-4a0a-9196-4550e502b771 tempest-VolumeDependencyTests-1182238293 None] Lock "cinder-quobyte-f13f5b6c-ce99-4bf7-856d-79314f632538" released by "_delete_snapshot" :: held 2.403s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-00140377-29e8-4a0a-9196-4550e502b771 tempest-VolumeDependencyTests-1182238293 None] Lock "cinder-quobyte-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a" released by "delete_snapshot" :: held 2.440s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:40 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-00140377-29e8-4a0a-9196-4550e502b771 tempest-VolumeDependencyTests-1182238293 None] Created reservations ['6c3e1d8b-8069-41c2-b020-2bfe329750e2', '6db436bb-0eb8-47bf-838a-410dc9c3471d', 'fe75c002-4577-40a8-a5dc-d5c83e82b2bd', '227e0508-0a34-4ceb-91a7-81a23dfeab3f'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:17:40 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-00140377-29e8-4a0a-9196-4550e502b771 tempest-VolumeDependencyTests-1182238293 None] Delete snapshot completed successfully. Sep 28 18:17:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-00140377-29e8-4a0a-9196-4550e502b771 tempest-VolumeDependencyTests-1182238293 None] Lock "cinder-f13f5b6c-ce99-4bf7-856d-79314f632538-delete_snapshot" released by "delete_snapshot" :: held 2.643s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-177c5428-7ed5-4d3d-9ad0-a834a3e610a8 tempest-TestImageHashVerification-748875059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-177c5428-7ed5-4d3d-9ad0-a834a3e610a8 tempest-TestImageHashVerification-748875059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:40 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[56633f48-f189-4636-a64e-c6205f77f412]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:17:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-177c5428-7ed5-4d3d-9ad0-a834a3e610a8 tempest-TestImageHashVerification-748875059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-efce1114-fb8b-4590-9b8d-8b0522b3c4d9 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5c93a73c-5918-46c9-b266-31d81cae22e3 tempest-VolumeDependencyTests-1182238293 None] Acquiring lock "cinder-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5c93a73c-5918-46c9-b266-31d81cae22e3 tempest-VolumeDependencyTests-1182238293 None] Lock "cinder-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5c93a73c-5918-46c9-b266-31d81cae22e3 tempest-VolumeDependencyTests-1182238293 None] Acquiring lock "cinder-quobyte-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:41 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-efce1114-fb8b-4590-9b8d-8b0522b3c4d9 Sep 28 18:17:41 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5c93a73c-5918-46c9-b266-31d81cae22e3 tempest-VolumeDependencyTests-1182238293 None] Lock "cinder-quobyte-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a" acquired by "delete_volume" :: waited 0.029s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:41 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12569ad-0a3d-47b3-bf2a-313e9b1b698a]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:17:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5c93a73c-5918-46c9-b266-31d81cae22e3 tempest-VolumeDependencyTests-1182238293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:41 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a Sep 28 18:17:41 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:41 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-177c5428-7ed5-4d3d-9ad0-a834a3e610a8 tempest-TestImageHashVerification-748875059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-efce1114-fb8b-4590-9b8d-8b0522b3c4d9" returned: 0 in 0.751s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:41 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef36da19-044a-41c7-84c8-7146a2469415]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:17:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-177c5428-7ed5-4d3d-9ad0-a834a3e610a8 tempest-TestImageHashVerification-748875059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-efce1114-fb8b-4590-9b8d-8b0522b3c4d9 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:41 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5c93a73c-5918-46c9-b266-31d81cae22e3 tempest-VolumeDependencyTests-1182238293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a" returned: 0 in 0.591s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5c93a73c-5918-46c9-b266-31d81cae22e3 tempest-VolumeDependencyTests-1182238293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:41 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-efce1114-fb8b-4590-9b8d-8b0522b3c4d9 Sep 28 18:17:41 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:41 devstack sudo[101103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a Sep 28 18:17:41 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:42 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-177c5428-7ed5-4d3d-9ad0-a834a3e610a8 tempest-TestImageHashVerification-748875059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-efce1114-fb8b-4590-9b8d-8b0522b3c4d9" returned: 0 in 0.486s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:42 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-177c5428-7ed5-4d3d-9ad0-a834a3e610a8 tempest-TestImageHashVerification-748875059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-efce1114-fb8b-4590-9b8d-8b0522b3c4d9 /opt/stack/data/cinder/conversion/efce1114-fb8b-4590-9b8d-8b0522b3c4d9.temp_image.fbef34e5-f7d0-4c4b-a5d3-02a1e55a7f4384rplytk.img {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5c93a73c-5918-46c9-b266-31d81cae22e3 tempest-VolumeDependencyTests-1182238293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a" returned: 0 in 0.350s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:42 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-efce1114-fb8b-4590-9b8d-8b0522b3c4d9 /opt/stack/data/cinder/conversion/efce1114-fb8b-4590-9b8d-8b0522b3c4d9.temp_image.fbef34e5-f7d0-4c4b-a5d3-02a1e55a7f4384rplytk.img Sep 28 18:17:42 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5c93a73c-5918-46c9-b266-31d81cae22e3 tempest-VolumeDependencyTests-1182238293 None] Lock "cinder-quobyte-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a" released by "delete_volume" :: held 1.067s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:42 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-5c93a73c-5918-46c9-b266-31d81cae22e3 tempest-VolumeDependencyTests-1182238293 None] Created reservations ['af91711e-70de-4582-81d1-526832b109b5', '6ef1a7ec-1715-4a2d-8bd3-d42b4183f0ee', '7fdaddbb-4593-4216-8e20-400b5c7abc99', '99d3843a-b1f9-4fff-92dd-8c7f37c2608a'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:17:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5c93a73c-5918-46c9-b266-31d81cae22e3 tempest-VolumeDependencyTests-1182238293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5c93a73c-5918-46c9-b266-31d81cae22e3 tempest-VolumeDependencyTests-1182238293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-5c93a73c-5918-46c9-b266-31d81cae22e3 tempest-VolumeDependencyTests-1182238293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-5c93a73c-5918-46c9-b266-31d81cae22e3 tempest-VolumeDependencyTests-1182238293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5c93a73c-5918-46c9-b266-31d81cae22e3 tempest-VolumeDependencyTests-1182238293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5c93a73c-5918-46c9-b266-31d81cae22e3 tempest-VolumeDependencyTests-1182238293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:42 devstack sudo[101112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:17:42 devstack sudo[101112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:42 devstack sudo[101112]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5c93a73c-5918-46c9-b266-31d81cae22e3 tempest-VolumeDependencyTests-1182238293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.490s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:42 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-5c93a73c-5918-46c9-b266-31d81cae22e3 tempest-VolumeDependencyTests-1182238293 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:17:42 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-5c93a73c-5918-46c9-b266-31d81cae22e3 tempest-VolumeDependencyTests-1182238293 None] Deleted volume successfully. Sep 28 18:17:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5c93a73c-5918-46c9-b266-31d81cae22e3 tempest-VolumeDependencyTests-1182238293 None] Lock "cinder-1fef6f1c-bd4e-4f30-a0ae-6f10ea87770a-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5d6ffe49-d3dc-4c19-893d-a4ca6a9470a0 tempest-VolumeDependencyTests-1182238293 None] Acquiring lock "cinder-1575eb57-4197-4bf9-aa14-c49d3797a618-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5d6ffe49-d3dc-4c19-893d-a4ca6a9470a0 tempest-VolumeDependencyTests-1182238293 None] Lock "cinder-1575eb57-4197-4bf9-aa14-c49d3797a618-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5d6ffe49-d3dc-4c19-893d-a4ca6a9470a0 tempest-VolumeDependencyTests-1182238293 None] Acquiring lock "cinder-quobyte-1575eb57-4197-4bf9-aa14-c49d3797a618" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:17:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5d6ffe49-d3dc-4c19-893d-a4ca6a9470a0 tempest-VolumeDependencyTests-1182238293 None] Lock "cinder-quobyte-1575eb57-4197-4bf9-aa14-c49d3797a618" acquired by "delete_volume" :: waited 0.060s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:17:43 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3704d95-8676-4328-8d18-690c9272e3f5]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:17:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5d6ffe49-d3dc-4c19-893d-a4ca6a9470a0 tempest-VolumeDependencyTests-1182238293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1575eb57-4197-4bf9-aa14-c49d3797a618 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:44 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1575eb57-4197-4bf9-aa14-c49d3797a618 Sep 28 18:17:44 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:44 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5d6ffe49-d3dc-4c19-893d-a4ca6a9470a0 tempest-VolumeDependencyTests-1182238293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1575eb57-4197-4bf9-aa14-c49d3797a618" returned: 0 in 0.914s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5d6ffe49-d3dc-4c19-893d-a4ca6a9470a0 tempest-VolumeDependencyTests-1182238293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1575eb57-4197-4bf9-aa14-c49d3797a618 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:44 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1575eb57-4197-4bf9-aa14-c49d3797a618 Sep 28 18:17:44 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:45 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5d6ffe49-d3dc-4c19-893d-a4ca6a9470a0 tempest-VolumeDependencyTests-1182238293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1575eb57-4197-4bf9-aa14-c49d3797a618" returned: 0 in 0.897s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:45 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5d6ffe49-d3dc-4c19-893d-a4ca6a9470a0 tempest-VolumeDependencyTests-1182238293 None] Lock "cinder-quobyte-1575eb57-4197-4bf9-aa14-c49d3797a618" released by "delete_volume" :: held 1.928s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:45 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-5d6ffe49-d3dc-4c19-893d-a4ca6a9470a0 tempest-VolumeDependencyTests-1182238293 None] Created reservations ['c5134958-8e29-4ca7-b0d1-c0f5a8243aaf', '87651efd-aee8-4d47-8324-b77c0bc437a1', 'f4dbb188-f960-4848-b659-c1d491eeb341', '3838075b-8c97-462c-ba43-6d18f70c7fcb'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:17:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5d6ffe49-d3dc-4c19-893d-a4ca6a9470a0 tempest-VolumeDependencyTests-1182238293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:17:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5d6ffe49-d3dc-4c19-893d-a4ca6a9470a0 tempest-VolumeDependencyTests-1182238293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:17:46 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-5d6ffe49-d3dc-4c19-893d-a4ca6a9470a0 tempest-VolumeDependencyTests-1182238293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:17:46 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-5d6ffe49-d3dc-4c19-893d-a4ca6a9470a0 tempest-VolumeDependencyTests-1182238293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:17:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5d6ffe49-d3dc-4c19-893d-a4ca6a9470a0 tempest-VolumeDependencyTests-1182238293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:17:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5d6ffe49-d3dc-4c19-893d-a4ca6a9470a0 tempest-VolumeDependencyTests-1182238293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:46 devstack sudo[101137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:17:46 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:47 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5d6ffe49-d3dc-4c19-893d-a4ca6a9470a0 tempest-VolumeDependencyTests-1182238293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.794s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:47 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-5d6ffe49-d3dc-4c19-893d-a4ca6a9470a0 tempest-VolumeDependencyTests-1182238293 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:17:47 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-5d6ffe49-d3dc-4c19-893d-a4ca6a9470a0 tempest-VolumeDependencyTests-1182238293 None] Deleted volume successfully. Sep 28 18:17:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5d6ffe49-d3dc-4c19-893d-a4ca6a9470a0 tempest-VolumeDependencyTests-1182238293 None] Lock "cinder-1575eb57-4197-4bf9-aa14-c49d3797a618-delete_volume" released by "delete_volume" :: held 3.536s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:17:50 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-177c5428-7ed5-4d3d-9ad0-a834a3e610a8 tempest-TestImageHashVerification-748875059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-efce1114-fb8b-4590-9b8d-8b0522b3c4d9 /opt/stack/data/cinder/conversion/efce1114-fb8b-4590-9b8d-8b0522b3c4d9.temp_image.fbef34e5-f7d0-4c4b-a5d3-02a1e55a7f4384rplytk.img" returned: 0 in 8.637s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:50 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6309e72-62a8-4e28-a3e7-7da6b760dcc1]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:17:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-177c5428-7ed5-4d3d-9ad0-a834a3e610a8 tempest-TestImageHashVerification-748875059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-efce1114-fb8b-4590-9b8d-8b0522b3c4d9 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:17:51 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-efce1114-fb8b-4590-9b8d-8b0522b3c4d9 Sep 28 18:17:51 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:17:51 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Sep 28 18:17:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-177c5428-7ed5-4d3d-9ad0-a834a3e610a8 tempest-TestImageHashVerification-748875059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-efce1114-fb8b-4590-9b8d-8b0522b3c4d9" returned: 0 in 0.613s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:17:51 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-177c5428-7ed5-4d3d-9ad0-a834a3e610a8 tempest-TestImageHashVerification-748875059 None] Image conversion details: src /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-efce1114-fb8b-4590-9b8d-8b0522b3c4d9, size 1024.00 MB, duration 8.64 sec, destination /opt/stack/data/cinder/conversion/efce1114-fb8b-4590-9b8d-8b0522b3c4d9.temp_image.fbef34e5-f7d0-4c4b-a5d3-02a1e55a7f4384rplytk.img {{(pid=86980) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:17:51 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-177c5428-7ed5-4d3d-9ad0-a834a3e610a8 tempest-TestImageHashVerification-748875059 None] Converted 1024.00 MB image at 118.54 MB/s Sep 28 18:17:51 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-177c5428-7ed5-4d3d-9ad0-a834a3e610a8 tempest-TestImageHashVerification-748875059 None] fbef34e5-f7d0-4c4b-a5d3-02a1e55a7f43 was raw, no need to convert to raw {{(pid=86980) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 18:17:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-91c03c80-4326-4136-9ed5-582e7e4832e3 req-99727b2f-d6b4-4dbf-8390-d60e980f4c3d tempest-TestServerVolumeAttachmentScenario-1055790954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:18:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:04 devstack sudo[101221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:18:04 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:05 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.459s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:05 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:18:05 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager._thread_info {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:18:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread count: 28 {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:18:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread info: [<_MainThread(MainThread, started 129097393381504)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:18:08 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=31,cinder:UPDATE=26,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:18:08 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=22,cinder:UPDATE=35,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:18:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-177c5428-7ed5-4d3d-9ad0-a834a3e610a8 tempest-TestImageHashVerification-748875059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.577s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:12 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-177c5428-7ed5-4d3d-9ad0-a834a3e610a8 tempest-TestImageHashVerification-748875059 None] Uploaded volume to glance image-id: fbef34e5-f7d0-4c4b-a5d3-02a1e55a7f43. {{(pid=86980) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 18:18:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 31.023s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:12 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Cloning volume 6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16 to volume b4d80834-19da-41a5-bb1a-f2af035dc8bc Sep 28 18:18:12 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-177c5428-7ed5-4d3d-9ad0-a834a3e610a8 tempest-TestImageHashVerification-748875059 None] Copy volume to image completed successfully. Sep 28 18:18:12 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Creating offline snapshot e1f2961b-bb6b-4f68-aa3b-4c2729cdf610 of volume 6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:18:12 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0558c732-9345-46c5-a7e0-28d08dd5cd8f]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:12 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16 Sep 28 18:18:12 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:13 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16" returned: 0 in 0.470s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.e1f2961b-bb6b-4f68-aa3b-4c2729cdf610 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:13 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.e1f2961b-bb6b-4f68-aa3b-4c2729cdf610 1G Sep 28 18:18:13 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:13 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fca32b04-e05d-4263-90ac-656bc23b616a tempest-TestImageHashVerification-748875059 None] Acquiring lock "cinder-efce1114-fb8b-4590-9b8d-8b0522b3c4d9-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:13 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fca32b04-e05d-4263-90ac-656bc23b616a tempest-TestImageHashVerification-748875059 None] Lock "cinder-efce1114-fb8b-4590-9b8d-8b0522b3c4d9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:13 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fca32b04-e05d-4263-90ac-656bc23b616a tempest-TestImageHashVerification-748875059 None] Acquiring lock "cinder-quobyte-efce1114-fb8b-4590-9b8d-8b0522b3c4d9" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:13 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fca32b04-e05d-4263-90ac-656bc23b616a tempest-TestImageHashVerification-748875059 None] Lock "cinder-quobyte-efce1114-fb8b-4590-9b8d-8b0522b3c4d9" acquired by "delete_volume" :: waited 0.018s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:13 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a2d446-e0b7-4f47-b350-df4237c0be54]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fca32b04-e05d-4263-90ac-656bc23b616a tempest-TestImageHashVerification-748875059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-efce1114-fb8b-4590-9b8d-8b0522b3c4d9 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:13 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-efce1114-fb8b-4590-9b8d-8b0522b3c4d9 Sep 28 18:18:13 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:13 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.e1f2961b-bb6b-4f68-aa3b-4c2729cdf610 1G" returned: 0 in 0.572s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.e1f2961b-bb6b-4f68-aa3b-4c2729cdf610 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:13 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.e1f2961b-bb6b-4f68-aa3b-4c2729cdf610 Sep 28 18:18:13 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:13 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fca32b04-e05d-4263-90ac-656bc23b616a tempest-TestImageHashVerification-748875059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-efce1114-fb8b-4590-9b8d-8b0522b3c4d9" returned: 0 in 0.424s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fca32b04-e05d-4263-90ac-656bc23b616a tempest-TestImageHashVerification-748875059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-efce1114-fb8b-4590-9b8d-8b0522b3c4d9 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:13 devstack sudo[101243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-efce1114-fb8b-4590-9b8d-8b0522b3c4d9 Sep 28 18:18:13 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:14 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.e1f2961b-bb6b-4f68-aa3b-4c2729cdf610" returned: 0 in 0.358s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:14 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.e1f2961b-bb6b-4f68-aa3b-4c2729cdf610 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:18:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.e1f2961b-bb6b-4f68-aa3b-4c2729cdf610 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:14 devstack sudo[101248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.e1f2961b-bb6b-4f68-aa3b-4c2729cdf610 Sep 28 18:18:14 devstack sudo[101248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:14 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fca32b04-e05d-4263-90ac-656bc23b616a tempest-TestImageHashVerification-748875059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-efce1114-fb8b-4590-9b8d-8b0522b3c4d9" returned: 0 in 0.286s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:14 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fca32b04-e05d-4263-90ac-656bc23b616a tempest-TestImageHashVerification-748875059 None] Lock "cinder-quobyte-efce1114-fb8b-4590-9b8d-8b0522b3c4d9" released by "delete_volume" :: held 0.757s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:14 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-fca32b04-e05d-4263-90ac-656bc23b616a tempest-TestImageHashVerification-748875059 None] Created reservations ['68eaac26-01f8-4879-827e-bbcbaf9d0774', '5c720096-5aa2-4df3-9b90-b231b94e8149', 'af469207-d276-4319-8936-7a4f15a630e2', '645388d5-54f4-42c8-9a42-12041b6f994e'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:18:14 devstack sudo[101248]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.e1f2961b-bb6b-4f68-aa3b-4c2729cdf610" returned: 0 in 0.283s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-fca32b04-e05d-4263-90ac-656bc23b616a tempest-TestImageHashVerification-748875059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-fca32b04-e05d-4263-90ac-656bc23b616a tempest-TestImageHashVerification-748875059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:14 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-fca32b04-e05d-4263-90ac-656bc23b616a tempest-TestImageHashVerification-748875059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:14 devstack sudo[101252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.info Sep 28 18:18:14 devstack sudo[101252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:14 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-fca32b04-e05d-4263-90ac-656bc23b616a tempest-TestImageHashVerification-748875059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-fca32b04-e05d-4263-90ac-656bc23b616a tempest-TestImageHashVerification-748875059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fca32b04-e05d-4263-90ac-656bc23b616a tempest-TestImageHashVerification-748875059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:14 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:18:14 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:14 devstack sudo[101252]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.info" returned: 0 in 0.341s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:14 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:18:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:14 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fca32b04-e05d-4263-90ac-656bc23b616a tempest-TestImageHashVerification-748875059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.328s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:14 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-fca32b04-e05d-4263-90ac-656bc23b616a tempest-TestImageHashVerification-748875059 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:18:14 devstack sudo[101258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.info Sep 28 18:18:14 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-fca32b04-e05d-4263-90ac-656bc23b616a tempest-TestImageHashVerification-748875059 None] Deleted volume successfully. Sep 28 18:18:14 devstack sudo[101258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:14 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fca32b04-e05d-4263-90ac-656bc23b616a tempest-TestImageHashVerification-748875059 None] Lock "cinder-efce1114-fb8b-4590-9b8d-8b0522b3c4d9-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:14 devstack sudo[101258]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.info" returned: 0 in 0.284s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:15 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Acquiring lock "cinder-quobyte-b4d80834-19da-41a5-bb1a-f2af035dc8bc" by "_copy_volume_from_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:15 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Lock "cinder-quobyte-b4d80834-19da-41a5-bb1a-f2af035dc8bc" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:15 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] snapshot: e1f2961b-bb6b-4f68-aa3b-4c2729cdf610, volume: b4d80834-19da-41a5-bb1a-f2af035dc8bc, {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:18:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:15 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:15 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:15 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcb553d-dfbe-4aed-bcaf-515782a24015]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.e1f2961b-bb6b-4f68-aa3b-4c2729cdf610 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:15 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.e1f2961b-bb6b-4f68-aa3b-4c2729cdf610 Sep 28 18:18:15 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:15 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.e1f2961b-bb6b-4f68-aa3b-4c2729cdf610" returned: 0 in 0.522s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:15 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:18:15 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7dcdf77-34a0-4092-9f8b-3d38ba07510a]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:15 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16 Sep 28 18:18:15 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:16 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16" returned: 0 in 0.469s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16 {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:18:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Creating direct copy from snapshot {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:18:16 devstack cinder-volume[86980]: DEBUG cinder.utils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Path /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b4d80834-19da-41a5-bb1a-f2af035dc8bc not found in is_blk_device check {{(pid=86980) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:18:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b4d80834-19da-41a5-bb1a-f2af035dc8bc {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:16 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b4d80834-19da-41a5-bb1a-f2af035dc8bc Sep 28 18:18:16 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:24 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b4d80834-19da-41a5-bb1a-f2af035dc8bc" returned: 0 in 8.013s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:24 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Image conversion details: src /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16, size 1024.00 MB, duration 8.01 sec, destination /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b4d80834-19da-41a5-bb1a-f2af035dc8bc {{(pid=86980) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:18:24 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Converted 1024.00 MB image at 127.78 MB/s Sep 28 18:18:24 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b4d80834-19da-41a5-bb1a-f2af035dc8bc is being set with open permissions: ugo+rw: NotImplementedError Sep 28 18:18:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b4d80834-19da-41a5-bb1a-f2af035dc8bc {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:24 devstack sudo[101289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b4d80834-19da-41a5-bb1a-f2af035dc8bc Sep 28 18:18:24 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:24 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=9,cinder:UPDATE=10,cinder:INSERT=4 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:18:24 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b4d80834-19da-41a5-bb1a-f2af035dc8bc" returned: 0 in 0.331s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:24 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Lock "cinder-quobyte-b4d80834-19da-41a5-bb1a-f2af035dc8bc" released by "_copy_volume_from_snapshot" :: held 9.441s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:24 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Acquiring lock "cinder-quobyte-e1f2961b-bb6b-4f68-aa3b-4c2729cdf610" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:24 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Lock "cinder-quobyte-e1f2961b-bb6b-4f68-aa3b-4c2729cdf610" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:24 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Deleting offline snapshot e1f2961b-bb6b-4f68-aa3b-4c2729cdf610 of volume 6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:18:24 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] snapshot_file for this snap is: volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.e1f2961b-bb6b-4f68-aa3b-4c2729cdf610 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:18:24 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65112eb-c424-42b8-8fe2-3677ba40a81d]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.e1f2961b-bb6b-4f68-aa3b-4c2729cdf610 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:24 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.e1f2961b-bb6b-4f68-aa3b-4c2729cdf610 Sep 28 18:18:24 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:25 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.e1f2961b-bb6b-4f68-aa3b-4c2729cdf610" returned: 0 in 0.634s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:25 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:18:25 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bea7543-2fa6-47d1-8e02-17f9f7b26bc5]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:25 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16 Sep 28 18:18:25 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:25 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16" returned: 0 in 0.631s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.e1f2961b-bb6b-4f68-aa3b-4c2729cdf610 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:25 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.e1f2961b-bb6b-4f68-aa3b-4c2729cdf610 Sep 28 18:18:25 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:26 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.e1f2961b-bb6b-4f68-aa3b-4c2729cdf610" returned: 0 in 0.546s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.e1f2961b-bb6b-4f68-aa3b-4c2729cdf610 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:26 devstack sudo[101314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.e1f2961b-bb6b-4f68-aa3b-4c2729cdf610 Sep 28 18:18:26 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:26 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16.e1f2961b-bb6b-4f68-aa3b-4c2729cdf610" returned: 0 in 0.373s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:26 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Lock "cinder-quobyte-e1f2961b-bb6b-4f68-aa3b-4c2729cdf610" released by "_delete_snapshot" :: held 2.306s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.306s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-91c03c80-4326-4136-9ed5-582e7e4832e3 req-99727b2f-d6b4-4dbf-8390-d60e980f4c3d tempest-TestServerVolumeAttachmentScenario-1055790954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 28.298s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-91c03c80-4326-4136-9ed5-582e7e4832e3 req-99727b2f-d6b4-4dbf-8390-d60e980f4c3d tempest-TestServerVolumeAttachmentScenario-1055790954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:26 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-91c03c80-4326-4136-9ed5-582e7e4832e3 req-99727b2f-d6b4-4dbf-8390-d60e980f4c3d tempest-TestServerVolumeAttachmentScenario-1055790954 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729', 'name': 'volume-29cf397a-4c10-4e3b-99cf-e65674c29b10', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9dcc66d5-59e3-4bbb-afcf-ee5c66924266', 'enforce_multipath': True} {{(pid=86980) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:18:26 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-1dca170c-13b9-4d82-b013-c1ce417ab502 tempest-GroupsV314Test-970195440 None] Create group from source-group-93f08157-abb5-4205-a10f-3e33181f89fa completed successfully. Sep 28 18:18:26 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-91c03c80-4326-4136-9ed5-582e7e4832e3 req-99727b2f-d6b4-4dbf-8390-d60e980f4c3d tempest-TestServerVolumeAttachmentScenario-1055790954 None] attachment_update completed successfully. Sep 28 18:18:27 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-2f28f62e-0298-4aba-bd3f-1dd9d215774b tempest-GroupsV314Test-970195440 None] Acquiring lock "cinder-quobyte-b4d80834-19da-41a5-bb1a-f2af035dc8bc" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:28 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-2f28f62e-0298-4aba-bd3f-1dd9d215774b tempest-GroupsV314Test-970195440 None] Lock "cinder-quobyte-b4d80834-19da-41a5-bb1a-f2af035dc8bc" acquired by "delete_volume" :: waited 0.020s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:28 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b0ea2d-c406-4bb7-85b4-3197d097ab0d]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2f28f62e-0298-4aba-bd3f-1dd9d215774b tempest-GroupsV314Test-970195440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b4d80834-19da-41a5-bb1a-f2af035dc8bc {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:28 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b4d80834-19da-41a5-bb1a-f2af035dc8bc Sep 28 18:18:28 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:28 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2f28f62e-0298-4aba-bd3f-1dd9d215774b tempest-GroupsV314Test-970195440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b4d80834-19da-41a5-bb1a-f2af035dc8bc" returned: 0 in 0.532s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2f28f62e-0298-4aba-bd3f-1dd9d215774b tempest-GroupsV314Test-970195440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b4d80834-19da-41a5-bb1a-f2af035dc8bc {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:28 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b4d80834-19da-41a5-bb1a-f2af035dc8bc Sep 28 18:18:28 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:28 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2f28f62e-0298-4aba-bd3f-1dd9d215774b tempest-GroupsV314Test-970195440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b4d80834-19da-41a5-bb1a-f2af035dc8bc" returned: 0 in 0.323s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:28 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-2f28f62e-0298-4aba-bd3f-1dd9d215774b tempest-GroupsV314Test-970195440 None] Lock "cinder-quobyte-b4d80834-19da-41a5-bb1a-f2af035dc8bc" released by "delete_volume" :: held 0.931s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:29 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-2f28f62e-0298-4aba-bd3f-1dd9d215774b tempest-GroupsV314Test-970195440 None] Created reservations ['06d3d79a-a5f2-4010-9b7b-965823dfcbde'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:18:29 devstack cinder-volume[86980]: WARNING cinder.quota [None req-2f28f62e-0298-4aba-bd3f-1dd9d215774b tempest-GroupsV314Test-970195440 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-313273136 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-313273136, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:18:29 devstack cinder-volume[86980]: WARNING cinder.quota [None req-2f28f62e-0298-4aba-bd3f-1dd9d215774b tempest-GroupsV314Test-970195440 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-313273136 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-313273136, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:18:29 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-2f28f62e-0298-4aba-bd3f-1dd9d215774b tempest-GroupsV314Test-970195440 None] Created reservations ['61b986ab-192a-4e21-a326-0697f12a7714', '3322d16a-208c-42d5-8099-c07da596468c', 'ac20a64b-70ae-4b9e-bc29-e9eab1154bac', 'de87a68e-55aa-4677-b868-db69b8de689f'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:18:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2f28f62e-0298-4aba-bd3f-1dd9d215774b tempest-GroupsV314Test-970195440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2f28f62e-0298-4aba-bd3f-1dd9d215774b tempest-GroupsV314Test-970195440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2f28f62e-0298-4aba-bd3f-1dd9d215774b tempest-GroupsV314Test-970195440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2f28f62e-0298-4aba-bd3f-1dd9d215774b tempest-GroupsV314Test-970195440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2f28f62e-0298-4aba-bd3f-1dd9d215774b tempest-GroupsV314Test-970195440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2f28f62e-0298-4aba-bd3f-1dd9d215774b tempest-GroupsV314Test-970195440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:29 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:18:29 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:29 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2f28f62e-0298-4aba-bd3f-1dd9d215774b tempest-GroupsV314Test-970195440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.342s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:29 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-2f28f62e-0298-4aba-bd3f-1dd9d215774b tempest-GroupsV314Test-970195440 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:18:29 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-2f28f62e-0298-4aba-bd3f-1dd9d215774b tempest-GroupsV314Test-970195440 None] Delete group completed successfully. Sep 28 18:18:29 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-458570ae-d63b-4ee9-84be-7e2c9c30c564 tempest-GroupsV314Test-970195440 None] Acquiring lock "cinder-quobyte-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:29 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-458570ae-d63b-4ee9-84be-7e2c9c30c564 tempest-GroupsV314Test-970195440 None] Lock "cinder-quobyte-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16" acquired by "delete_volume" :: waited 0.023s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:29 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[db675a53-3ec6-4780-904f-16de69cf36b0]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-458570ae-d63b-4ee9-84be-7e2c9c30c564 tempest-GroupsV314Test-970195440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:30 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16 Sep 28 18:18:30 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:30 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-458570ae-d63b-4ee9-84be-7e2c9c30c564 tempest-GroupsV314Test-970195440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16" returned: 0 in 0.475s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-458570ae-d63b-4ee9-84be-7e2c9c30c564 tempest-GroupsV314Test-970195440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:30 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16 Sep 28 18:18:30 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:30 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-458570ae-d63b-4ee9-84be-7e2c9c30c564 tempest-GroupsV314Test-970195440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16" returned: 0 in 0.314s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:30 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-458570ae-d63b-4ee9-84be-7e2c9c30c564 tempest-GroupsV314Test-970195440 None] Lock "cinder-quobyte-6ff46e4d-0ab5-4c3e-8ed3-a849b5792a16" released by "delete_volume" :: held 0.873s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:30 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-458570ae-d63b-4ee9-84be-7e2c9c30c564 tempest-GroupsV314Test-970195440 None] Created reservations ['6a71e595-f65f-4ef2-9bbd-8c3cd6bedf51'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:18:30 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-458570ae-d63b-4ee9-84be-7e2c9c30c564 tempest-GroupsV314Test-970195440 None] Created reservations ['041ceda0-f1c2-45b1-aa3a-cca5ca17aa3d', 'd529b436-e19d-42b1-9616-245df8448d55', '836f71fd-f757-463c-9c9c-8f3bd175d6d6', '2fedc0ba-4666-418d-ac2a-176f0c710b7f'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:18:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-458570ae-d63b-4ee9-84be-7e2c9c30c564 tempest-GroupsV314Test-970195440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-458570ae-d63b-4ee9-84be-7e2c9c30c564 tempest-GroupsV314Test-970195440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:30 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-458570ae-d63b-4ee9-84be-7e2c9c30c564 tempest-GroupsV314Test-970195440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:30 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-458570ae-d63b-4ee9-84be-7e2c9c30c564 tempest-GroupsV314Test-970195440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-458570ae-d63b-4ee9-84be-7e2c9c30c564 tempest-GroupsV314Test-970195440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-458570ae-d63b-4ee9-84be-7e2c9c30c564 tempest-GroupsV314Test-970195440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:31 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:18:31 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:31 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-458570ae-d63b-4ee9-84be-7e2c9c30c564 tempest-GroupsV314Test-970195440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.349s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:31 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-458570ae-d63b-4ee9-84be-7e2c9c30c564 tempest-GroupsV314Test-970195440 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:18:31 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-458570ae-d63b-4ee9-84be-7e2c9c30c564 tempest-GroupsV314Test-970195440 None] Delete group completed successfully. Sep 28 18:18:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-4d82088a-97e3-4e30-9779-ff20ebad4e21 req-83b2c27d-b782-482e-b1bd-33aa45865dde tempest-TestServerVolumeAttachmentScenario-1055790954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-4d82088a-97e3-4e30-9779-ff20ebad4e21 req-83b2c27d-b782-482e-b1bd-33aa45865dde tempest-TestServerVolumeAttachmentScenario-1055790954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-4d82088a-97e3-4e30-9779-ff20ebad4e21 req-83b2c27d-b782-482e-b1bd-33aa45865dde tempest-TestServerVolumeAttachmentScenario-1055790954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-4d82088a-97e3-4e30-9779-ff20ebad4e21 req-83b2c27d-b782-482e-b1bd-33aa45865dde tempest-TestServerVolumeAttachmentScenario-1055790954 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729', 'name': 'volume-2afc0a26-cca9-4d9d-a32f-b4ec74cceb2e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd3ee54a8-6d31-4086-946c-40741d435e77', 'enforce_multipath': True} {{(pid=86980) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:18:33 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-4d82088a-97e3-4e30-9779-ff20ebad4e21 req-83b2c27d-b782-482e-b1bd-33aa45865dde tempest-TestServerVolumeAttachmentScenario-1055790954 None] attachment_update completed successfully. Sep 28 18:18:37 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-7c8bc279-c598-48b3-892b-062e71bd5b24 req-3960eed9-aa6c-4525-8591-706be5c0ba7f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Terminate volume connection completed successfully. Sep 28 18:18:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-7c8bc279-c598-48b3-892b-062e71bd5b24 req-3960eed9-aa6c-4525-8591-706be5c0ba7f tempest-TestServerVolumeAttachmentScenario-1055790954 None] Deleting attachment d3ee54a8-6d31-4086-946c-40741d435e77. {{(pid=86980) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:18:38 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-78f6ed81-3b76-4980-85ef-a39d6abdd92a req-65e7b268-9b20-43ed-81b2-ae0d1c3eddca tempest-TestServerVolumeAttachmentScenario-1055790954 None] Terminate volume connection completed successfully. Sep 28 18:18:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-78f6ed81-3b76-4980-85ef-a39d6abdd92a req-65e7b268-9b20-43ed-81b2-ae0d1c3eddca tempest-TestServerVolumeAttachmentScenario-1055790954 None] Deleting attachment 9dcc66d5-59e3-4bbb-afcf-ee5c66924266. {{(pid=86980) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:18:44 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-089d66a0-01e1-4a70-8b07-e06cbef62076 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Acquiring lock "cinder-2afc0a26-cca9-4d9d-a32f-b4ec74cceb2e-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:44 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-089d66a0-01e1-4a70-8b07-e06cbef62076 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Lock "cinder-2afc0a26-cca9-4d9d-a32f-b4ec74cceb2e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:44 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-089d66a0-01e1-4a70-8b07-e06cbef62076 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Acquiring lock "cinder-quobyte-2afc0a26-cca9-4d9d-a32f-b4ec74cceb2e" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:44 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-089d66a0-01e1-4a70-8b07-e06cbef62076 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Lock "cinder-quobyte-2afc0a26-cca9-4d9d-a32f-b4ec74cceb2e" acquired by "delete_volume" :: waited 0.023s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:44 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de5977c-e427-4478-bc3a-f6a89564fbb2]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-089d66a0-01e1-4a70-8b07-e06cbef62076 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2afc0a26-cca9-4d9d-a32f-b4ec74cceb2e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:45 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2afc0a26-cca9-4d9d-a32f-b4ec74cceb2e Sep 28 18:18:45 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:45 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-089d66a0-01e1-4a70-8b07-e06cbef62076 tempest-TestServerVolumeAttachmentScenario-1055790954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2afc0a26-cca9-4d9d-a32f-b4ec74cceb2e" returned: 0 in 0.526s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-089d66a0-01e1-4a70-8b07-e06cbef62076 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2afc0a26-cca9-4d9d-a32f-b4ec74cceb2e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:45 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2afc0a26-cca9-4d9d-a32f-b4ec74cceb2e Sep 28 18:18:45 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:45 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-089d66a0-01e1-4a70-8b07-e06cbef62076 tempest-TestServerVolumeAttachmentScenario-1055790954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2afc0a26-cca9-4d9d-a32f-b4ec74cceb2e" returned: 0 in 0.425s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:45 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-089d66a0-01e1-4a70-8b07-e06cbef62076 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Lock "cinder-quobyte-2afc0a26-cca9-4d9d-a32f-b4ec74cceb2e" released by "delete_volume" :: held 1.031s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:46 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-089d66a0-01e1-4a70-8b07-e06cbef62076 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Created reservations ['38b7e1fa-b936-47d4-b3bb-2640f24ce697', '24236d58-3471-4180-b9fc-f10394649d31', '440e2747-bbf1-48b5-9ee4-543946f6bc68', 'c7b9c78f-58d1-4e8c-a81c-c91535d892e6'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:18:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-089d66a0-01e1-4a70-8b07-e06cbef62076 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-089d66a0-01e1-4a70-8b07-e06cbef62076 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:46 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-089d66a0-01e1-4a70-8b07-e06cbef62076 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:46 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-089d66a0-01e1-4a70-8b07-e06cbef62076 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-089d66a0-01e1-4a70-8b07-e06cbef62076 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-089d66a0-01e1-4a70-8b07-e06cbef62076 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:46 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:18:46 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:46 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-089d66a0-01e1-4a70-8b07-e06cbef62076 tempest-TestServerVolumeAttachmentScenario-1055790954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.329s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:46 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-089d66a0-01e1-4a70-8b07-e06cbef62076 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:18:46 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-089d66a0-01e1-4a70-8b07-e06cbef62076 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Deleted volume successfully. Sep 28 18:18:46 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-089d66a0-01e1-4a70-8b07-e06cbef62076 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Lock "cinder-2afc0a26-cca9-4d9d-a32f-b4ec74cceb2e-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1e7c7a66-7569-4640-aee9-6187dfb6dce9 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Acquiring lock "cinder-29cf397a-4c10-4e3b-99cf-e65674c29b10-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1e7c7a66-7569-4640-aee9-6187dfb6dce9 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Lock "cinder-29cf397a-4c10-4e3b-99cf-e65674c29b10-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1e7c7a66-7569-4640-aee9-6187dfb6dce9 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Acquiring lock "cinder-quobyte-29cf397a-4c10-4e3b-99cf-e65674c29b10" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:18:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1e7c7a66-7569-4640-aee9-6187dfb6dce9 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Lock "cinder-quobyte-29cf397a-4c10-4e3b-99cf-e65674c29b10" acquired by "delete_volume" :: waited 0.017s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:18:47 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3caa2449-23d8-4a5e-9b59-2c84e25da3bd]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:18:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1e7c7a66-7569-4640-aee9-6187dfb6dce9 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-29cf397a-4c10-4e3b-99cf-e65674c29b10 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:47 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-29cf397a-4c10-4e3b-99cf-e65674c29b10 Sep 28 18:18:47 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:47 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1e7c7a66-7569-4640-aee9-6187dfb6dce9 tempest-TestServerVolumeAttachmentScenario-1055790954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-29cf397a-4c10-4e3b-99cf-e65674c29b10" returned: 0 in 0.482s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1e7c7a66-7569-4640-aee9-6187dfb6dce9 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-29cf397a-4c10-4e3b-99cf-e65674c29b10 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:47 devstack sudo[101862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-29cf397a-4c10-4e3b-99cf-e65674c29b10 Sep 28 18:18:47 devstack sudo[101862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:48 devstack sudo[101862]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1e7c7a66-7569-4640-aee9-6187dfb6dce9 tempest-TestServerVolumeAttachmentScenario-1055790954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-29cf397a-4c10-4e3b-99cf-e65674c29b10" returned: 0 in 0.300s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:48 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1e7c7a66-7569-4640-aee9-6187dfb6dce9 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Lock "cinder-quobyte-29cf397a-4c10-4e3b-99cf-e65674c29b10" released by "delete_volume" :: held 0.849s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:48 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-1e7c7a66-7569-4640-aee9-6187dfb6dce9 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Created reservations ['80b6311f-5e60-4921-a92c-8417654cb800', '862112d8-20f3-4634-aa87-0a3c826f976c', '7b6c032f-3b47-45ac-8b4b-1b0e7dd579d9', '168fdcc1-1b41-470c-ac1e-c08db3ced5c0'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:18:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1e7c7a66-7569-4640-aee9-6187dfb6dce9 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:18:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1e7c7a66-7569-4640-aee9-6187dfb6dce9 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:18:48 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1e7c7a66-7569-4640-aee9-6187dfb6dce9 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:18:48 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1e7c7a66-7569-4640-aee9-6187dfb6dce9 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:18:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1e7c7a66-7569-4640-aee9-6187dfb6dce9 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:18:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1e7c7a66-7569-4640-aee9-6187dfb6dce9 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:18:48 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:18:48 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:18:48 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Sep 28 18:18:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1e7c7a66-7569-4640-aee9-6187dfb6dce9 tempest-TestServerVolumeAttachmentScenario-1055790954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.402s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:18:48 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-1e7c7a66-7569-4640-aee9-6187dfb6dce9 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:18:48 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-1e7c7a66-7569-4640-aee9-6187dfb6dce9 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Deleted volume successfully. Sep 28 18:18:48 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1e7c7a66-7569-4640-aee9-6187dfb6dce9 tempest-TestServerVolumeAttachmentScenario-1055790954 None] Lock "cinder-29cf397a-4c10-4e3b-99cf-e65674c29b10-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:18:58 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:UPDATE=48,cinder:INSERT=10,cinder:SELECT=53,cinder:DELETE=2 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:18:58 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:UPDATE=48,cinder:SELECT=40,cinder:INSERT=10,cinder:DELETE=1 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:19:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:19:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:04 devstack sudo[101915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:19:04 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:05 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.429s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:05 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:05 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager._thread_info {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:19:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread count: 28 {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:19:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread info: [<_MainThread(MainThread, started 129097393381504)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:19:06 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Flow 'volume_create_manager' (0bfd588f-9ea5-4560-8310-e8a8e9d767a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16348070-bf97-4331-8af0-9a434c7f6439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16348070-bf97-4331-8af0-9a434c7f6439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1602837549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab0d3e8-312a-46bb-8a02-ae93840ed026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='431abc66d46c487ba803b6cbbed3fb43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:06Z,use_quota=True,user_id='185f344044d84e2c9768aade7a14e2c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed65a983-8d86-4ca7-9c03-d4f75670676e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed65a983-8d86-4ca7-9c03-d4f75670676e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92af1dc-1dbe-474c-ab3c-21d6942d8990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92af1dc-1dbe-474c-ab3c-21d6942d8990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dab0d3e8-312a-46bb-8a02-ae93840ed026', 'volume_name': 'volume-dab0d3e8-312a-46bb-8a02-ae93840ed026', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a673a1-755f-46d5-b0f5-95ab90d19840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a673a1-755f-46d5-b0f5-95ab90d19840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bba55473-bf4d-4566-9d9f-c0166a441a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:06 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Volume dab0d3e8-312a-46bb-8a02-ae93840ed026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dab0d3e8-312a-46bb-8a02-ae93840ed026', 'volume_size': 1} Sep 28 18:19:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1602837549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab0d3e8-312a-46bb-8a02-ae93840ed026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='431abc66d46c487ba803b6cbbed3fb43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:06Z,use_quota=True,user_id='185f344044d84e2c9768aade7a14e2c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Creating volume dab0d3e8-312a-46bb-8a02-ae93840ed026 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:06 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:19:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:06 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026 1073741824 Sep 28 18:19:06 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:07 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026 1073741824" returned: 0 in 0.905s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:07 devstack sudo[101924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026 Sep 28 18:19:07 devstack sudo[101924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:07 devstack sudo[101924]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026" returned: 0 in 0.386s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bba55473-bf4d-4566-9d9f-c0166a441a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dab0d3e8-312a-46bb-8a02-ae93840ed026', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3561bc7-f368-4be4-b287-ecd9340789a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:07 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Volume volume-dab0d3e8-312a-46bb-8a02-ae93840ed026 (dab0d3e8-312a-46bb-8a02-ae93840ed026): created successfully Sep 28 18:19:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3561bc7-f368-4be4-b287-ecd9340789a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Flow 'volume_create_manager' (0bfd588f-9ea5-4560-8310-e8a8e9d767a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:07 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-aa379977-ad5e-45c8-9fcc-17bd4a05c495 tempest-TestStampPattern-57928506 None] Created volume successfully. Sep 28 18:19:14 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Flow 'volume_create_manager' (e90dd360-ef00-4c78-8f12-c0dcd7eadb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c1274e-371a-44a5-bae8-3f8f957296c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c1274e-371a-44a5-bae8-3f8f957296c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-204243270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=486cba53-995c-4808-8b43-487f77c9ee3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ded45d229804f3e8d9fd952cae29e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:14Z,use_quota=True,user_id='01947a4a4a684c7caba9167a8a8860bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d94800b-90bb-4e87-a003-8282aea81042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d94800b-90bb-4e87-a003-8282aea81042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78001080-e7a5-45af-b816-20f28675b7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78001080-e7a5-45af-b816-20f28675b7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '486cba53-995c-4808-8b43-487f77c9ee3b', 'volume_name': 'volume-486cba53-995c-4808-8b43-487f77c9ee3b', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe7c6dba-d5a3-4fd7-baf5-9cbc3dfc40ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe7c6dba-d5a3-4fd7-baf5-9cbc3dfc40ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0e36fa8-8679-41c0-ad2a-a668c2b4d395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:14 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Volume 486cba53-995c-4808-8b43-487f77c9ee3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-486cba53-995c-4808-8b43-487f77c9ee3b', 'volume_size': 1} Sep 28 18:19:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:14 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-204243270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=486cba53-995c-4808-8b43-487f77c9ee3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ded45d229804f3e8d9fd952cae29e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:14Z,use_quota=True,user_id='01947a4a4a684c7caba9167a8a8860bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:14 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Creating volume 486cba53-995c-4808-8b43-487f77c9ee3b {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:14 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:14 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:14 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:14 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:19:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-486cba53-995c-4808-8b43-487f77c9ee3b 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:14 devstack sudo[101952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-486cba53-995c-4808-8b43-487f77c9ee3b 1073741824 Sep 28 18:19:14 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:15 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-486cba53-995c-4808-8b43-487f77c9ee3b 1073741824" returned: 0 in 0.992s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-486cba53-995c-4808-8b43-487f77c9ee3b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:15 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-486cba53-995c-4808-8b43-487f77c9ee3b Sep 28 18:19:15 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:16 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-486cba53-995c-4808-8b43-487f77c9ee3b" returned: 0 in 0.479s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0e36fa8-8679-41c0-ad2a-a668c2b4d395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-486cba53-995c-4808-8b43-487f77c9ee3b', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42b93ee1-3433-4d77-8dc1-59aa0206f555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:16 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Volume volume-486cba53-995c-4808-8b43-487f77c9ee3b (486cba53-995c-4808-8b43-487f77c9ee3b): created successfully Sep 28 18:19:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42b93ee1-3433-4d77-8dc1-59aa0206f555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Flow 'volume_create_manager' (e90dd360-ef00-4c78-8f12-c0dcd7eadb33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:16 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-0edf16be-5fc5-4368-8b5d-9502de4b62ef tempest-ProjectReaderTests-520522391 None] Created volume successfully. Sep 28 18:19:16 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4d8323e2-16bc-4e0f-95df-2e7adfc17d10 tempest-ProjectReaderTests-520522391 None] Acquiring lock "cinder-486cba53-995c-4808-8b43-487f77c9ee3b-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:16 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4d8323e2-16bc-4e0f-95df-2e7adfc17d10 tempest-ProjectReaderTests-520522391 None] Lock "cinder-486cba53-995c-4808-8b43-487f77c9ee3b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:16 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4d8323e2-16bc-4e0f-95df-2e7adfc17d10 tempest-ProjectReaderTests-520522391 None] Acquiring lock "cinder-quobyte-486cba53-995c-4808-8b43-487f77c9ee3b" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:16 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4d8323e2-16bc-4e0f-95df-2e7adfc17d10 tempest-ProjectReaderTests-520522391 None] Lock "cinder-quobyte-486cba53-995c-4808-8b43-487f77c9ee3b" acquired by "delete_volume" :: waited 0.016s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:17 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[718d5487-58a6-4d1f-8aed-17d0980ddef6]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4d8323e2-16bc-4e0f-95df-2e7adfc17d10 tempest-ProjectReaderTests-520522391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-486cba53-995c-4808-8b43-487f77c9ee3b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:17 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-486cba53-995c-4808-8b43-487f77c9ee3b Sep 28 18:19:17 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:17 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4d8323e2-16bc-4e0f-95df-2e7adfc17d10 tempest-ProjectReaderTests-520522391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-486cba53-995c-4808-8b43-487f77c9ee3b" returned: 0 in 0.515s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4d8323e2-16bc-4e0f-95df-2e7adfc17d10 tempest-ProjectReaderTests-520522391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-486cba53-995c-4808-8b43-487f77c9ee3b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:17 devstack sudo[102048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-486cba53-995c-4808-8b43-487f77c9ee3b Sep 28 18:19:17 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:18 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4d8323e2-16bc-4e0f-95df-2e7adfc17d10 tempest-ProjectReaderTests-520522391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-486cba53-995c-4808-8b43-487f77c9ee3b" returned: 0 in 0.495s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4d8323e2-16bc-4e0f-95df-2e7adfc17d10 tempest-ProjectReaderTests-520522391 None] Lock "cinder-quobyte-486cba53-995c-4808-8b43-487f77c9ee3b" released by "delete_volume" :: held 1.094s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:18 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-4d8323e2-16bc-4e0f-95df-2e7adfc17d10 tempest-ProjectReaderTests-520522391 None] Created reservations ['3fb2e288-7892-49b4-a5f3-5d8404313a2e', 'b403d8ac-449d-4c1f-8a3a-9ecce14358e6', '0ed4d2e7-73e3-4163-b328-a9e32eb40d89', '41794e2a-f0d6-4fe6-9b2c-aadd18517a18'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4d8323e2-16bc-4e0f-95df-2e7adfc17d10 tempest-ProjectReaderTests-520522391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4d8323e2-16bc-4e0f-95df-2e7adfc17d10 tempest-ProjectReaderTests-520522391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4d8323e2-16bc-4e0f-95df-2e7adfc17d10 tempest-ProjectReaderTests-520522391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4d8323e2-16bc-4e0f-95df-2e7adfc17d10 tempest-ProjectReaderTests-520522391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4d8323e2-16bc-4e0f-95df-2e7adfc17d10 tempest-ProjectReaderTests-520522391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4d8323e2-16bc-4e0f-95df-2e7adfc17d10 tempest-ProjectReaderTests-520522391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:18 devstack sudo[102053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:19:18 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:18 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4d8323e2-16bc-4e0f-95df-2e7adfc17d10 tempest-ProjectReaderTests-520522391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.469s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:18 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-4d8323e2-16bc-4e0f-95df-2e7adfc17d10 tempest-ProjectReaderTests-520522391 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:18 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-4d8323e2-16bc-4e0f-95df-2e7adfc17d10 tempest-ProjectReaderTests-520522391 None] Deleted volume successfully. Sep 28 18:19:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4d8323e2-16bc-4e0f-95df-2e7adfc17d10 tempest-ProjectReaderTests-520522391 None] Lock "cinder-486cba53-995c-4808-8b43-487f77c9ee3b-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:20 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Flow 'volume_create_manager' (52d64f4f-b57b-44b0-b179-eed8aa3aa796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f2307a2-c8e2-4965-a294-29a2819a5f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f2307a2-c8e2-4965-a294-29a2819a5f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1935514543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a47b327-bb31-483e-837a-785ca7e1040b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ded45d229804f3e8d9fd952cae29e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:20Z,use_quota=True,user_id='01947a4a4a684c7caba9167a8a8860bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64beb15b-e99c-47ac-b990-8ad095fbdf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64beb15b-e99c-47ac-b990-8ad095fbdf0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654e0c8d-f624-4a46-85ce-a9c1c20328b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654e0c8d-f624-4a46-85ce-a9c1c20328b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a47b327-bb31-483e-837a-785ca7e1040b', 'volume_name': 'volume-3a47b327-bb31-483e-837a-785ca7e1040b', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c29c6d-bfc6-450d-8dea-3da8d5754375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c29c6d-bfc6-450d-8dea-3da8d5754375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8a8e8f-e91c-47ed-ab50-18c26bda6aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:20 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Volume 3a47b327-bb31-483e-837a-785ca7e1040b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a47b327-bb31-483e-837a-785ca7e1040b', 'volume_size': 1} Sep 28 18:19:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:20 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1935514543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a47b327-bb31-483e-837a-785ca7e1040b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ded45d229804f3e8d9fd952cae29e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:20Z,use_quota=True,user_id='01947a4a4a684c7caba9167a8a8860bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:20 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Creating volume 3a47b327-bb31-483e-837a-785ca7e1040b {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:20 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:20 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:20 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:20 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:19:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3a47b327-bb31-483e-837a-785ca7e1040b 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:20 devstack sudo[102056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3a47b327-bb31-483e-837a-785ca7e1040b 1073741824 Sep 28 18:19:20 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:21 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3a47b327-bb31-483e-837a-785ca7e1040b 1073741824" returned: 0 in 0.900s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3a47b327-bb31-483e-837a-785ca7e1040b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:21 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3a47b327-bb31-483e-837a-785ca7e1040b Sep 28 18:19:21 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:21 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3a47b327-bb31-483e-837a-785ca7e1040b" returned: 0 in 0.305s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:21 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8a8e8f-e91c-47ed-ab50-18c26bda6aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a47b327-bb31-483e-837a-785ca7e1040b', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca4b8951-c847-448e-b2fa-70a51884241b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:21 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Volume volume-3a47b327-bb31-483e-837a-785ca7e1040b (3a47b327-bb31-483e-837a-785ca7e1040b): created successfully Sep 28 18:19:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca4b8951-c847-448e-b2fa-70a51884241b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Flow 'volume_create_manager' (52d64f4f-b57b-44b0-b179-eed8aa3aa796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:21 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-f4315763-6345-4b05-9d60-bd0a557456e0 tempest-ProjectReaderTests-520522391 None] Created volume successfully. Sep 28 18:19:22 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c93f869f-316f-4627-b6e9-f0448449fc6f tempest-ProjectReaderTests-520522391 None] Acquiring lock "cinder-3a47b327-bb31-483e-837a-785ca7e1040b-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:22 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c93f869f-316f-4627-b6e9-f0448449fc6f tempest-ProjectReaderTests-520522391 None] Lock "cinder-3a47b327-bb31-483e-837a-785ca7e1040b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:22 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c93f869f-316f-4627-b6e9-f0448449fc6f tempest-ProjectReaderTests-520522391 None] Acquiring lock "cinder-quobyte-3a47b327-bb31-483e-837a-785ca7e1040b" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:22 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c93f869f-316f-4627-b6e9-f0448449fc6f tempest-ProjectReaderTests-520522391 None] Lock "cinder-quobyte-3a47b327-bb31-483e-837a-785ca7e1040b" acquired by "delete_volume" :: waited 0.021s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:22 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e14543c-a6e4-4807-acc9-ae92a332e5fe]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c93f869f-316f-4627-b6e9-f0448449fc6f tempest-ProjectReaderTests-520522391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3a47b327-bb31-483e-837a-785ca7e1040b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:22 devstack sudo[102067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3a47b327-bb31-483e-837a-785ca7e1040b Sep 28 18:19:22 devstack sudo[102067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:23 devstack sudo[102067]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c93f869f-316f-4627-b6e9-f0448449fc6f tempest-ProjectReaderTests-520522391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3a47b327-bb31-483e-837a-785ca7e1040b" returned: 0 in 0.534s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c93f869f-316f-4627-b6e9-f0448449fc6f tempest-ProjectReaderTests-520522391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3a47b327-bb31-483e-837a-785ca7e1040b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:23 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3a47b327-bb31-483e-837a-785ca7e1040b Sep 28 18:19:23 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:23 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c93f869f-316f-4627-b6e9-f0448449fc6f tempest-ProjectReaderTests-520522391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-3a47b327-bb31-483e-837a-785ca7e1040b" returned: 0 in 0.336s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c93f869f-316f-4627-b6e9-f0448449fc6f tempest-ProjectReaderTests-520522391 None] Lock "cinder-quobyte-3a47b327-bb31-483e-837a-785ca7e1040b" released by "delete_volume" :: held 0.962s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:23 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-c93f869f-316f-4627-b6e9-f0448449fc6f tempest-ProjectReaderTests-520522391 None] Created reservations ['5159b2f3-7846-431b-a248-68fd9d6da809', 'c79b42e6-3573-4432-9518-b700c162f8f8', 'b2c59420-3966-4e1d-9ff8-7c0dfc45bf6b', '8944e42a-29c0-4fd9-b7fa-e76512096c74'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c93f869f-316f-4627-b6e9-f0448449fc6f tempest-ProjectReaderTests-520522391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c93f869f-316f-4627-b6e9-f0448449fc6f tempest-ProjectReaderTests-520522391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c93f869f-316f-4627-b6e9-f0448449fc6f tempest-ProjectReaderTests-520522391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c93f869f-316f-4627-b6e9-f0448449fc6f tempest-ProjectReaderTests-520522391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c93f869f-316f-4627-b6e9-f0448449fc6f tempest-ProjectReaderTests-520522391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c93f869f-316f-4627-b6e9-f0448449fc6f tempest-ProjectReaderTests-520522391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:23 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:19:23 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:23 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c93f869f-316f-4627-b6e9-f0448449fc6f tempest-ProjectReaderTests-520522391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.398s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:24 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-c93f869f-316f-4627-b6e9-f0448449fc6f tempest-ProjectReaderTests-520522391 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:19:24 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-c93f869f-316f-4627-b6e9-f0448449fc6f tempest-ProjectReaderTests-520522391 None] Deleted volume successfully. Sep 28 18:19:24 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c93f869f-316f-4627-b6e9-f0448449fc6f tempest-ProjectReaderTests-520522391 None] Lock "cinder-3a47b327-bb31-483e-837a-785ca7e1040b-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:33 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:UPDATE=24,cinder:SELECT=15,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:19:34 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=17,cinder:UPDATE=26,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:19:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-f32f4f6a-0095-4d1c-8906-2a6bed6899f2 req-78753794-ea87-46f5-a4d4-050232cecf8b tempest-TestStampPattern-57928506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-f32f4f6a-0095-4d1c-8906-2a6bed6899f2 req-78753794-ea87-46f5-a4d4-050232cecf8b tempest-TestStampPattern-57928506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-f32f4f6a-0095-4d1c-8906-2a6bed6899f2 req-78753794-ea87-46f5-a4d4-050232cecf8b tempest-TestStampPattern-57928506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-f32f4f6a-0095-4d1c-8906-2a6bed6899f2 req-78753794-ea87-46f5-a4d4-050232cecf8b tempest-TestStampPattern-57928506 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729', 'name': 'volume-dab0d3e8-312a-46bb-8a02-ae93840ed026', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9d03235-5090-487a-9572-da22223c907a', 'enforce_multipath': True} {{(pid=86980) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:19:48 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-f32f4f6a-0095-4d1c-8906-2a6bed6899f2 req-78753794-ea87-46f5-a4d4-050232cecf8b tempest-TestStampPattern-57928506 None] attachment_update completed successfully. Sep 28 18:19:49 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Flow 'volume_create_manager' (233f272c-aa9e-426a-b181-f6a35ed83386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac251212-b185-4472-8260-4ab65557886c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac251212-b185-4472-8260-4ab65557886c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1688504159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e1ae389-5b43-45d7-ad79-be3095c225b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9142a702077d4e5abdbd6b04ecccedff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:49Z,use_quota=True,user_id='34ceac2571c34115b1bd28d6ba4fb6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57075e6b-0348-4baf-8f3c-62bf9aae5f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57075e6b-0348-4baf-8f3c-62bf9aae5f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfef618e-fa5d-429e-b90b-2b9d0a32ef47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfef618e-fa5d-429e-b90b-2b9d0a32ef47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e1ae389-5b43-45d7-ad79-be3095c225b8', 'volume_name': 'volume-8e1ae389-5b43-45d7-ad79-be3095c225b8', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12c2b03-c9e9-4e6e-9ad3-54849f85c460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12c2b03-c9e9-4e6e-9ad3-54849f85c460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a17fd613-48ba-4ae6-ad81-b3213f358932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:49 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Volume 8e1ae389-5b43-45d7-ad79-be3095c225b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e1ae389-5b43-45d7-ad79-be3095c225b8', 'volume_size': 1} Sep 28 18:19:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1688504159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e1ae389-5b43-45d7-ad79-be3095c225b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9142a702077d4e5abdbd6b04ecccedff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:49Z,use_quota=True,user_id='34ceac2571c34115b1bd28d6ba4fb6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:19:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Creating volume 8e1ae389-5b43-45d7-ad79-be3095c225b8 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:19:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:19:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:19:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:19:49 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:19:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:49 devstack sudo[102550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8 1073741824 Sep 28 18:19:49 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:49 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8 1073741824" returned: 0 in 0.677s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:49 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8 Sep 28 18:19:49 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:50 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8" returned: 0 in 0.351s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:19:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a17fd613-48ba-4ae6-ad81-b3213f358932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e1ae389-5b43-45d7-ad79-be3095c225b8', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1a7406-7c6c-41c1-a908-c5d417d81a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:50 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Volume volume-8e1ae389-5b43-45d7-ad79-be3095c225b8 (8e1ae389-5b43-45d7-ad79-be3095c225b8): created successfully Sep 28 18:19:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1a7406-7c6c-41c1-a908-c5d417d81a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Flow 'volume_create_manager' (233f272c-aa9e-426a-b181-f6a35ed83386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:50 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-d4718a99-11fd-4e26-8b44-d1e289d97610 tempest-VolumesSnapshotTestJSON-606072181 None] Created volume successfully. Sep 28 18:19:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-79b9e126-1884-458a-ac61-7600a03dc4b0 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-79b9e126-1884-458a-ac61-7600a03dc4b0 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:51 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-79b9e126-1884-458a-ac61-7600a03dc4b0 tempest-VolumesSnapshotTestJSON-606072181 None] Creating offline snapshot 77c2e783-5468-42c2-bce7-69e47562a512 of volume 8e1ae389-5b43-45d7-ad79-be3095c225b8 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:19:51 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[247cc9b3-5a11-436d-ace1-2cfc403507d0]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-79b9e126-1884-458a-ac61-7600a03dc4b0 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:51 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8 Sep 28 18:19:51 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:52 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-79b9e126-1884-458a-ac61-7600a03dc4b0 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8" returned: 0 in 0.519s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-79b9e126-1884-458a-ac61-7600a03dc4b0 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8.77c2e783-5468-42c2-bce7-69e47562a512 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:52 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8.77c2e783-5468-42c2-bce7-69e47562a512 1G Sep 28 18:19:52 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:52 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-79b9e126-1884-458a-ac61-7600a03dc4b0 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8.77c2e783-5468-42c2-bce7-69e47562a512 1G" returned: 0 in 0.612s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-79b9e126-1884-458a-ac61-7600a03dc4b0 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e1ae389-5b43-45d7-ad79-be3095c225b8 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8.77c2e783-5468-42c2-bce7-69e47562a512 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:52 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e1ae389-5b43-45d7-ad79-be3095c225b8 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8.77c2e783-5468-42c2-bce7-69e47562a512 Sep 28 18:19:52 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:53 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-79b9e126-1884-458a-ac61-7600a03dc4b0 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e1ae389-5b43-45d7-ad79-be3095c225b8 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8.77c2e783-5468-42c2-bce7-69e47562a512" returned: 0 in 0.358s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:53 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-79b9e126-1884-458a-ac61-7600a03dc4b0 tempest-VolumesSnapshotTestJSON-606072181 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8.77c2e783-5468-42c2-bce7-69e47562a512 is being set with open permissions: ugo+rw Sep 28 18:19:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-79b9e126-1884-458a-ac61-7600a03dc4b0 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8.77c2e783-5468-42c2-bce7-69e47562a512 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:53 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8.77c2e783-5468-42c2-bce7-69e47562a512 Sep 28 18:19:53 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:53 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-79b9e126-1884-458a-ac61-7600a03dc4b0 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8.77c2e783-5468-42c2-bce7-69e47562a512" returned: 0 in 0.364s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-79b9e126-1884-458a-ac61-7600a03dc4b0 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:53 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8.info Sep 28 18:19:53 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:54 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-79b9e126-1884-458a-ac61-7600a03dc4b0 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8.info" returned: 0 in 0.475s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:54 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-79b9e126-1884-458a-ac61-7600a03dc4b0 tempest-VolumesSnapshotTestJSON-606072181 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8.info is being set with open permissions: ugo+rw Sep 28 18:19:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-79b9e126-1884-458a-ac61-7600a03dc4b0 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:54 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8.info Sep 28 18:19:54 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:54 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-79b9e126-1884-458a-ac61-7600a03dc4b0 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8.info" returned: 0 in 0.339s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-79b9e126-1884-458a-ac61-7600a03dc4b0 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.842s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:19:54 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-79b9e126-1884-458a-ac61-7600a03dc4b0 tempest-VolumesSnapshotTestJSON-606072181 None] Create snapshot completed successfully Sep 28 18:19:54 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-16b50830-4a1f-4050-bce9-11e84740a622 req-489f7161-3535-4bad-afb7-35c36ba9a83d tempest-TestStampPattern-57928506 None] Terminate volume connection completed successfully. Sep 28 18:19:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-16b50830-4a1f-4050-bce9-11e84740a622 req-489f7161-3535-4bad-afb7-35c36ba9a83d tempest-TestStampPattern-57928506 None] Deleting attachment f9d03235-5090-487a-9572-da22223c907a. {{(pid=86980) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:19:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b9f3a911-3d65-4663-acf0-77652680840e tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "cinder-77c2e783-5468-42c2-bce7-69e47562a512-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b9f3a911-3d65-4663-acf0-77652680840e tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-77c2e783-5468-42c2-bce7-69e47562a512-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b9f3a911-3d65-4663-acf0-77652680840e tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "cinder-quobyte-8e1ae389-5b43-45d7-ad79-be3095c225b8" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b9f3a911-3d65-4663-acf0-77652680840e tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-8e1ae389-5b43-45d7-ad79-be3095c225b8" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b9f3a911-3d65-4663-acf0-77652680840e tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "cinder-quobyte-77c2e783-5468-42c2-bce7-69e47562a512" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:19:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b9f3a911-3d65-4663-acf0-77652680840e tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-77c2e783-5468-42c2-bce7-69e47562a512" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:19:55 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-b9f3a911-3d65-4663-acf0-77652680840e tempest-VolumesSnapshotTestJSON-606072181 None] Deleting offline snapshot 77c2e783-5468-42c2-bce7-69e47562a512 of volume 8e1ae389-5b43-45d7-ad79-be3095c225b8 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:19:55 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-b9f3a911-3d65-4663-acf0-77652680840e tempest-VolumesSnapshotTestJSON-606072181 None] snapshot_file for this snap is: volume-8e1ae389-5b43-45d7-ad79-be3095c225b8.77c2e783-5468-42c2-bce7-69e47562a512 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:19:55 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7ab13f-4792-48aa-890f-f715017d7e0a]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b9f3a911-3d65-4663-acf0-77652680840e tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8.77c2e783-5468-42c2-bce7-69e47562a512 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:55 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8.77c2e783-5468-42c2-bce7-69e47562a512 Sep 28 18:19:55 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:55 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b9f3a911-3d65-4663-acf0-77652680840e tempest-VolumesSnapshotTestJSON-606072181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8.77c2e783-5468-42c2-bce7-69e47562a512" returned: 0 in 0.573s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:55 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-b9f3a911-3d65-4663-acf0-77652680840e tempest-VolumesSnapshotTestJSON-606072181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e1ae389-5b43-45d7-ad79-be3095c225b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:19:55 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dda0f26-e3d7-44af-a6b1-1fec84fa5272]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b9f3a911-3d65-4663-acf0-77652680840e tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:56 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8 Sep 28 18:19:56 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:56 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b9f3a911-3d65-4663-acf0-77652680840e tempest-VolumesSnapshotTestJSON-606072181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8" returned: 0 in 0.661s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b9f3a911-3d65-4663-acf0-77652680840e tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8.77c2e783-5468-42c2-bce7-69e47562a512 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:56 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8.77c2e783-5468-42c2-bce7-69e47562a512 Sep 28 18:19:56 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-de37ec42-2cbc-4094-8941-0f15e8d8da04 tempest-TestStampPattern-57928506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-de37ec42-2cbc-4094-8941-0f15e8d8da04 tempest-TestStampPattern-57928506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:19:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-de37ec42-2cbc-4094-8941-0f15e8d8da04 tempest-TestStampPattern-57928506 None] Creating offline snapshot e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3 of volume dab0d3e8-312a-46bb-8a02-ae93840ed026 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:19:56 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb02999c-f46a-4878-91d7-6f2ba659023b]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:19:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-de37ec42-2cbc-4094-8941-0f15e8d8da04 tempest-TestStampPattern-57928506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:57 devstack sudo[102651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026 Sep 28 18:19:57 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:57 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b9f3a911-3d65-4663-acf0-77652680840e tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8.77c2e783-5468-42c2-bce7-69e47562a512" returned: 0 in 0.611s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b9f3a911-3d65-4663-acf0-77652680840e tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8.77c2e783-5468-42c2-bce7-69e47562a512 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:57 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8.77c2e783-5468-42c2-bce7-69e47562a512 Sep 28 18:19:57 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:57 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-de37ec42-2cbc-4094-8941-0f15e8d8da04 tempest-TestStampPattern-57928506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026" returned: 0 in 0.758s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-de37ec42-2cbc-4094-8941-0f15e8d8da04 tempest-TestStampPattern-57928506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:57 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3 1G Sep 28 18:19:57 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:57 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b9f3a911-3d65-4663-acf0-77652680840e tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8.77c2e783-5468-42c2-bce7-69e47562a512" returned: 0 in 0.457s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:57 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b9f3a911-3d65-4663-acf0-77652680840e tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-77c2e783-5468-42c2-bce7-69e47562a512" released by "_delete_snapshot" :: held 2.498s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:57 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b9f3a911-3d65-4663-acf0-77652680840e tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-8e1ae389-5b43-45d7-ad79-be3095c225b8" released by "delete_snapshot" :: held 2.534s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:57 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-b9f3a911-3d65-4663-acf0-77652680840e tempest-VolumesSnapshotTestJSON-606072181 None] Created reservations ['2fd9a215-b1ba-474f-8763-ec7d7c2783cb', '1e041cdf-38d0-4588-b538-bf818ef6e5aa', '1a207a79-35c1-40ee-8b08-6e3f4aa912e2', 'f098b3f8-b37b-43ef-99d3-07b08b126aec'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:19:58 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-b9f3a911-3d65-4663-acf0-77652680840e tempest-VolumesSnapshotTestJSON-606072181 None] Delete snapshot completed successfully. Sep 28 18:19:58 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b9f3a911-3d65-4663-acf0-77652680840e tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-77c2e783-5468-42c2-bce7-69e47562a512-delete_snapshot" released by "delete_snapshot" :: held 2.895s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:19:58 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-de37ec42-2cbc-4094-8941-0f15e8d8da04 tempest-TestStampPattern-57928506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3 1G" returned: 0 in 0.681s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-de37ec42-2cbc-4094-8941-0f15e8d8da04 tempest-TestStampPattern-57928506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dab0d3e8-312a-46bb-8a02-ae93840ed026 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:58 devstack sudo[102669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dab0d3e8-312a-46bb-8a02-ae93840ed026 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3 Sep 28 18:19:58 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:58 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-de37ec42-2cbc-4094-8941-0f15e8d8da04 tempest-TestStampPattern-57928506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dab0d3e8-312a-46bb-8a02-ae93840ed026 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3" returned: 0 in 0.485s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:58 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-de37ec42-2cbc-4094-8941-0f15e8d8da04 tempest-TestStampPattern-57928506 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3 is being set with open permissions: ugo+rw Sep 28 18:19:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-de37ec42-2cbc-4094-8941-0f15e8d8da04 tempest-TestStampPattern-57928506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:58 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3 Sep 28 18:19:58 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:59 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-de37ec42-2cbc-4094-8941-0f15e8d8da04 tempest-TestStampPattern-57928506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3" returned: 0 in 0.517s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-de37ec42-2cbc-4094-8941-0f15e8d8da04 tempest-TestStampPattern-57928506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:59 devstack sudo[102713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.info Sep 28 18:19:59 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:59 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:19:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Flow 'volume_create_manager' (d8e5c873-d895-4bff-a9d5-e06eb24295be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:19:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e159c68-2d1d-4385-92f2-850759d511f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e159c68-2d1d-4385-92f2-850759d511f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-193407792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3733b70-a398-4a17-94a8-88b672e07bc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9142a702077d4e5abdbd6b04ecccedff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:59Z,use_quota=True,user_id='34ceac2571c34115b1bd28d6ba4fb6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54ca91d-81c2-40e1-8298-beca0c45483f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54ca91d-81c2-40e1-8298-beca0c45483f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d42a1a7-4f0f-49a7-9d4c-1f7def206a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d42a1a7-4f0f-49a7-9d4c-1f7def206a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3733b70-a398-4a17-94a8-88b672e07bc3', 'volume_name': 'volume-a3733b70-a398-4a17-94a8-88b672e07bc3', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e34c8f40-7bc9-4fe6-9571-f878f4868f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e34c8f40-7bc9-4fe6-9571-f878f4868f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:19:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40065c2a-a821-4293-8ce7-e99b0a1c33af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:19:59 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Volume a3733b70-a398-4a17-94a8-88b672e07bc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3733b70-a398-4a17-94a8-88b672e07bc3', 'volume_size': 1} Sep 28 18:19:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:19:59 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-de37ec42-2cbc-4094-8941-0f15e8d8da04 tempest-TestStampPattern-57928506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.info" returned: 0 in 0.314s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:59 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-de37ec42-2cbc-4094-8941-0f15e8d8da04 tempest-TestStampPattern-57928506 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.info is being set with open permissions: ugo+rw Sep 28 18:19:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-de37ec42-2cbc-4094-8941-0f15e8d8da04 tempest-TestStampPattern-57928506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:19:59 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.info Sep 28 18:19:59 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:19:59 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Sep 28 18:19:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-de37ec42-2cbc-4094-8941-0f15e8d8da04 tempest-TestStampPattern-57928506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.info" returned: 0 in 0.276s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:19:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-de37ec42-2cbc-4094-8941-0f15e8d8da04 tempest-TestStampPattern-57928506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.201s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.400s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-193407792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3733b70-a398-4a17-94a8-88b672e07bc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9142a702077d4e5abdbd6b04ecccedff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:19:59Z,use_quota=True,user_id='34ceac2571c34115b1bd28d6ba4fb6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Creating volume a3733b70-a398-4a17-94a8-88b672e07bc3 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:00 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:20:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:00 devstack sudo[102725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3 1073741824 Sep 28 18:20:00 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:00 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-de37ec42-2cbc-4094-8941-0f15e8d8da04 tempest-TestStampPattern-57928506 None] Create snapshot completed successfully Sep 28 18:20:00 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3 1073741824" returned: 0 in 0.590s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:00 devstack sudo[102731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3 Sep 28 18:20:00 devstack sudo[102731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:01 devstack sudo[102731]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3" returned: 0 in 0.435s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40065c2a-a821-4293-8ce7-e99b0a1c33af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3733b70-a398-4a17-94a8-88b672e07bc3', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d8a4e5-e72d-4ac1-a0bd-9ce360ccc430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:01 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Volume volume-a3733b70-a398-4a17-94a8-88b672e07bc3 (a3733b70-a398-4a17-94a8-88b672e07bc3): created successfully Sep 28 18:20:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d8a4e5-e72d-4ac1-a0bd-9ce360ccc430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Flow 'volume_create_manager' (d8e5c873-d895-4bff-a9d5-e06eb24295be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:01 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-749e919b-b7ca-4514-95bd-b07dc13af1b6 tempest-VolumesSnapshotTestJSON-606072181 None] Created volume successfully. Sep 28 18:20:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-55501e2c-6bd9-4a08-b9ce-b89a84fcbf9a tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-55501e2c-6bd9-4a08-b9ce-b89a84fcbf9a tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-55501e2c-6bd9-4a08-b9ce-b89a84fcbf9a tempest-VolumesSnapshotTestJSON-606072181 None] Creating offline snapshot 9f150bdd-9ef1-4415-a0cd-bbe9939ac99e of volume a3733b70-a398-4a17-94a8-88b672e07bc3 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:20:01 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3ea40a-4a39-445f-a2fd-88f6557d1fc5]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-55501e2c-6bd9-4a08-b9ce-b89a84fcbf9a tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:02 devstack sudo[102735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3 Sep 28 18:20:02 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:02 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-55501e2c-6bd9-4a08-b9ce-b89a84fcbf9a tempest-VolumesSnapshotTestJSON-606072181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3" returned: 0 in 0.663s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-55501e2c-6bd9-4a08-b9ce-b89a84fcbf9a tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3.9f150bdd-9ef1-4415-a0cd-bbe9939ac99e 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:02 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3.9f150bdd-9ef1-4415-a0cd-bbe9939ac99e 1G Sep 28 18:20:02 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:03 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Flow 'volume_create_manager' (5e809d23-6024-44d4-a033-28c993507607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3575257-3fef-48b2-8f21-7dc4f5da3e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3575257-3fef-48b2-8f21-7dc4f5da3e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-336671974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6dac37f-e338-4eda-96a2-8894854d528b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa3f5e3343e4c11aafc9241a6ab5e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:03Z,use_quota=True,user_id='0a1fb7668d994c57a79b20e5cde66ff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde7891d-dcc0-4d7a-8fb4-1f71806d8558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde7891d-dcc0-4d7a-8fb4-1f71806d8558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ffe2503-e6f3-4ca3-8d2a-1ac036b28f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ffe2503-e6f3-4ca3-8d2a-1ac036b28f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6dac37f-e338-4eda-96a2-8894854d528b', 'volume_name': 'volume-d6dac37f-e338-4eda-96a2-8894854d528b', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6276da24-095a-46c6-98ae-edf44c86fba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6276da24-095a-46c6-98ae-edf44c86fba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a724c0-05ce-45e3-988c-af67f4d774a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:03 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Volume d6dac37f-e338-4eda-96a2-8894854d528b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6dac37f-e338-4eda-96a2-8894854d528b', 'volume_size': 1} Sep 28 18:20:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:03 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-55501e2c-6bd9-4a08-b9ce-b89a84fcbf9a tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3.9f150bdd-9ef1-4415-a0cd-bbe9939ac99e 1G" returned: 0 in 0.743s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-55501e2c-6bd9-4a08-b9ce-b89a84fcbf9a tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3733b70-a398-4a17-94a8-88b672e07bc3 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3.9f150bdd-9ef1-4415-a0cd-bbe9939ac99e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:03 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3733b70-a398-4a17-94a8-88b672e07bc3 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3.9f150bdd-9ef1-4415-a0cd-bbe9939ac99e Sep 28 18:20:03 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:03 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-55501e2c-6bd9-4a08-b9ce-b89a84fcbf9a tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3733b70-a398-4a17-94a8-88b672e07bc3 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3.9f150bdd-9ef1-4415-a0cd-bbe9939ac99e" returned: 0 in 0.347s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:03 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-55501e2c-6bd9-4a08-b9ce-b89a84fcbf9a tempest-VolumesSnapshotTestJSON-606072181 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3.9f150bdd-9ef1-4415-a0cd-bbe9939ac99e is being set with open permissions: ugo+rw Sep 28 18:20:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-55501e2c-6bd9-4a08-b9ce-b89a84fcbf9a tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3.9f150bdd-9ef1-4415-a0cd-bbe9939ac99e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:03 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3.9f150bdd-9ef1-4415-a0cd-bbe9939ac99e Sep 28 18:20:03 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:04 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-55501e2c-6bd9-4a08-b9ce-b89a84fcbf9a tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3.9f150bdd-9ef1-4415-a0cd-bbe9939ac99e" returned: 0 in 0.347s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-55501e2c-6bd9-4a08-b9ce-b89a84fcbf9a tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:04 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3.info Sep 28 18:20:04 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:04 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-55501e2c-6bd9-4a08-b9ce-b89a84fcbf9a tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3.info" returned: 0 in 0.311s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:04 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-55501e2c-6bd9-4a08-b9ce-b89a84fcbf9a tempest-VolumesSnapshotTestJSON-606072181 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3.info is being set with open permissions: ugo+rw Sep 28 18:20:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-55501e2c-6bd9-4a08-b9ce-b89a84fcbf9a tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:04 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3.info Sep 28 18:20:04 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:20:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:04 devstack sudo[102791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:20:04 devstack sudo[102791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:04 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-55501e2c-6bd9-4a08-b9ce-b89a84fcbf9a tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3.info" returned: 0 in 0.291s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-55501e2c-6bd9-4a08-b9ce-b89a84fcbf9a tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.847s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.536s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-336671974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6dac37f-e338-4eda-96a2-8894854d528b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa3f5e3343e4c11aafc9241a6ab5e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:03Z,use_quota=True,user_id='0a1fb7668d994c57a79b20e5cde66ff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Creating volume d6dac37f-e338-4eda-96a2-8894854d528b {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:04 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:20:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:04 devstack sudo[102794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b 1073741824 Sep 28 18:20:04 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:04 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-55501e2c-6bd9-4a08-b9ce-b89a84fcbf9a tempest-VolumesSnapshotTestJSON-606072181 None] Create snapshot completed successfully Sep 28 18:20:04 devstack sudo[102791]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.364s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:04 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager._thread_info {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:20:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread count: 28 {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:20:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread info: [<_MainThread(MainThread, started 129097393381504)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:20:05 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b 1073741824" returned: 0 in 0.655s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:05 devstack sudo[102810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b Sep 28 18:20:05 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:05 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b" returned: 0 in 0.369s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a724c0-05ce-45e3-988c-af67f4d774a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6dac37f-e338-4eda-96a2-8894854d528b', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b6459e0-dc86-41ac-aaba-b1234e26a587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:05 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:05 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Volume volume-d6dac37f-e338-4eda-96a2-8894854d528b (d6dac37f-e338-4eda-96a2-8894854d528b): created successfully Sep 28 18:20:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b6459e0-dc86-41ac-aaba-b1234e26a587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Flow 'volume_create_manager' (5e809d23-6024-44d4-a033-28c993507607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:05 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-a1d00abe-fe10-42df-9f0a-447b762e20ef tempest-SnapshotDependencyTests-408735362 None] Created volume successfully. Sep 28 18:20:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Flow 'volume_create_manager' (c6317d7a-28c2-4adf-bef4-2b215bdb2ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6121b1b4-91c1-447c-a120-9d4cbecdcd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6121b1b4-91c1-447c-a120-9d4cbecdcd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-196903325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0911bbb1-e5f4-48af-b4a8-e86f90dc960b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9142a702077d4e5abdbd6b04ecccedff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=9f150bdd-9ef1-4415-a0cd-bbe9939ac99e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:06Z,use_quota=True,user_id='34ceac2571c34115b1bd28d6ba4fb6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea75fd81-2618-4a5e-a821-db90ec5b94e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea75fd81-2618-4a5e-a821-db90ec5b94e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b456bd0-da7d-4237-a344-fa383b3c5ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b456bd0-da7d-4237-a344-fa383b3c5ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0911bbb1-e5f4-48af-b4a8-e86f90dc960b', 'volume_name': 'volume-0911bbb1-e5f4-48af-b4a8-e86f90dc960b', 'volume_size': 2, 'snapshot_id': '9f150bdd-9ef1-4415-a0cd-bbe9939ac99e'}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a9a256-98fa-4b70-a821-edcea675f4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a9a256-98fa-4b70-a821-edcea675f4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd111238-1bde-4c9c-aec4-1ac181a2f01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:06 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Volume 0911bbb1-e5f4-48af-b4a8-e86f90dc960b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0911bbb1-e5f4-48af-b4a8-e86f90dc960b', 'volume_size': 2, 'snapshot_id': '9f150bdd-9ef1-4415-a0cd-bbe9939ac99e'} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "cinder-quobyte-9f150bdd-9ef1-4415-a0cd-bbe9939ac99e-0911bbb1-e5f4-48af-b4a8-e86f90dc960b" by "_create_volume_from_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-9f150bdd-9ef1-4415-a0cd-bbe9939ac99e-0911bbb1-e5f4-48af-b4a8-e86f90dc960b" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Creating volume 0911bbb1-e5f4-48af-b4a8-e86f90dc960b from snapshot 9f150bdd-9ef1-4415-a0cd-bbe9939ac99e {{(pid=86980) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "cinder-quobyte-0911bbb1-e5f4-48af-b4a8-e86f90dc960b" by "_copy_volume_from_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-0911bbb1-e5f4-48af-b4a8-e86f90dc960b" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] snapshot: 9f150bdd-9ef1-4415-a0cd-bbe9939ac99e, volume: 0911bbb1-e5f4-48af-b4a8-e86f90dc960b, {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb7925d-cf25-4089-9ac6-e8f98378b34f]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3.9f150bdd-9ef1-4415-a0cd-bbe9939ac99e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:06 devstack sudo[102813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3.9f150bdd-9ef1-4415-a0cd-bbe9939ac99e Sep 28 18:20:06 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0107a576-3a31-4509-abf4-ab17c653dd89 tempest-SnapshotDependencyTests-408735362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:06 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3.9f150bdd-9ef1-4415-a0cd-bbe9939ac99e" returned: 0 in 0.507s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3733b70-a398-4a17-94a8-88b672e07bc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa112c7-9f6f-47de-aeed-7c7aa40f58c7]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:06 devstack sudo[102818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3 Sep 28 18:20:06 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:07 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3" returned: 0 in 0.455s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3 {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:20:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Creating direct copy from snapshot {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:20:07 devstack cinder-volume[86980]: DEBUG cinder.utils [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Path /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0911bbb1-e5f4-48af-b4a8-e86f90dc960b not found in is_blk_device check {{(pid=86980) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:20:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0911bbb1-e5f4-48af-b4a8-e86f90dc960b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:07 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0911bbb1-e5f4-48af-b4a8-e86f90dc960b Sep 28 18:20:07 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:11 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:11 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Flow 'volume_create_manager' (05e8faf9-24c3-4fe7-8e56-e49ca9c3b78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:11 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d1eaebc-3cab-44d2-a55f-e07ad8bdf47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:11 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d1eaebc-3cab-44d2-a55f-e07ad8bdf47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-332019603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd67098d-c998-4dcd-85a4-35ef902f6d35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='431abc66d46c487ba803b6cbbed3fb43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:11Z,use_quota=True,user_id='185f344044d84e2c9768aade7a14e2c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:11 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a26528d2-4764-40c9-8731-0902e5f93a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:11 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a26528d2-4764-40c9-8731-0902e5f93a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:11 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f48f12-5ae4-4c3d-91b9-bec6ae30dc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:11 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f48f12-5ae4-4c3d-91b9-bec6ae30dc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bd67098d-c998-4dcd-85a4-35ef902f6d35', 'volume_name': 'volume-bd67098d-c998-4dcd-85a4-35ef902f6d35', 'volume_size': 1, 'snapshot_id': 'e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3'}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:11 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f3d4312-16de-42d8-9291-040b9b45a2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:11 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f3d4312-16de-42d8-9291-040b9b45a2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:11 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb8722c-9e1f-4f13-8cda-57a0b8c5bde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:11 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Volume bd67098d-c998-4dcd-85a4-35ef902f6d35: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bd67098d-c998-4dcd-85a4-35ef902f6d35', 'volume_size': 1, 'snapshot_id': 'e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3'} Sep 28 18:20:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:14 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0911bbb1-e5f4-48af-b4a8-e86f90dc960b" returned: 0 in 7.783s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:15 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Image conversion details: src /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3, size 1024.00 MB, duration 7.78 sec, destination /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0911bbb1-e5f4-48af-b4a8-e86f90dc960b {{(pid=86980) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:20:15 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Converted 1024.00 MB image at 131.55 MB/s Sep 28 18:20:15 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0911bbb1-e5f4-48af-b4a8-e86f90dc960b is being set with open permissions: ugo+rw Sep 28 18:20:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0911bbb1-e5f4-48af-b4a8-e86f90dc960b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:15 devstack sudo[102840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0911bbb1-e5f4-48af-b4a8-e86f90dc960b Sep 28 18:20:15 devstack sudo[102840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:15 devstack sudo[102840]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0911bbb1-e5f4-48af-b4a8-e86f90dc960b" returned: 0 in 0.350s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:15 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-0911bbb1-e5f4-48af-b4a8-e86f90dc960b" released by "_copy_volume_from_snapshot" :: held 9.219s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:15 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-9f150bdd-9ef1-4415-a0cd-bbe9939ac99e-0911bbb1-e5f4-48af-b4a8-e86f90dc960b" released by "_create_volume_from_snapshot" :: held 9.323s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.351s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0107a576-3a31-4509-abf4-ab17c653dd89 tempest-SnapshotDependencyTests-408735362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.818s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:15 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-0107a576-3a31-4509-abf4-ab17c653dd89 tempest-SnapshotDependencyTests-408735362 None] Creating offline snapshot 01ef80b3-6911-40d1-822f-7ac18012abd8 of volume d6dac37f-e338-4eda-96a2-8894854d528b {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:20:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd111238-1bde-4c9c-aec4-1ac181a2f01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0911bbb1-e5f4-48af-b4a8-e86f90dc960b', 'volume_size': 2, 'snapshot_id': '9f150bdd-9ef1-4415-a0cd-bbe9939ac99e'}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (023c1d07-97a7-40ed-b15c-736aad807f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:15 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e40f40a-f11d-4d23-a799-5e2013ed79d9]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0107a576-3a31-4509-abf4-ab17c653dd89 tempest-SnapshotDependencyTests-408735362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:15 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Volume volume-0911bbb1-e5f4-48af-b4a8-e86f90dc960b (0911bbb1-e5f4-48af-b4a8-e86f90dc960b): created successfully Sep 28 18:20:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (023c1d07-97a7-40ed-b15c-736aad807f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Flow 'volume_create_manager' (c6317d7a-28c2-4adf-bef4-2b215bdb2ffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:15 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-7aa9ae4b-7f55-49dd-9a4f-4957ae389d50 tempest-VolumesSnapshotTestJSON-606072181 None] Created volume successfully. Sep 28 18:20:15 devstack sudo[102843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b Sep 28 18:20:15 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:15 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-399ce5d0-6210-4139-b704-ab5bf6f641e0 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "cinder-0911bbb1-e5f4-48af-b4a8-e86f90dc960b-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:15 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-399ce5d0-6210-4139-b704-ab5bf6f641e0 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-0911bbb1-e5f4-48af-b4a8-e86f90dc960b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:16 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-399ce5d0-6210-4139-b704-ab5bf6f641e0 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "cinder-quobyte-0911bbb1-e5f4-48af-b4a8-e86f90dc960b" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:16 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-399ce5d0-6210-4139-b704-ab5bf6f641e0 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-0911bbb1-e5f4-48af-b4a8-e86f90dc960b" acquired by "delete_volume" :: waited 0.030s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:16 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4681ba51-78e7-42ef-882c-dd0522a322ed]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-399ce5d0-6210-4139-b704-ab5bf6f641e0 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0911bbb1-e5f4-48af-b4a8-e86f90dc960b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:16 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0107a576-3a31-4509-abf4-ab17c653dd89 tempest-SnapshotDependencyTests-408735362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b" returned: 0 in 0.700s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0107a576-3a31-4509-abf4-ab17c653dd89 tempest-SnapshotDependencyTests-408735362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b.01ef80b3-6911-40d1-822f-7ac18012abd8 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:16 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b.01ef80b3-6911-40d1-822f-7ac18012abd8 1G Sep 28 18:20:16 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:16 devstack sudo[102848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0911bbb1-e5f4-48af-b4a8-e86f90dc960b Sep 28 18:20:16 devstack sudo[102848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:16 devstack sudo[102848]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-399ce5d0-6210-4139-b704-ab5bf6f641e0 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0911bbb1-e5f4-48af-b4a8-e86f90dc960b" returned: 0 in 0.691s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-399ce5d0-6210-4139-b704-ab5bf6f641e0 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0911bbb1-e5f4-48af-b4a8-e86f90dc960b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:16 devstack sudo[102859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0911bbb1-e5f4-48af-b4a8-e86f90dc960b Sep 28 18:20:16 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:17 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0107a576-3a31-4509-abf4-ab17c653dd89 tempest-SnapshotDependencyTests-408735362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b.01ef80b3-6911-40d1-822f-7ac18012abd8 1G" returned: 0 in 0.834s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0107a576-3a31-4509-abf4-ab17c653dd89 tempest-SnapshotDependencyTests-408735362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6dac37f-e338-4eda-96a2-8894854d528b -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b.01ef80b3-6911-40d1-822f-7ac18012abd8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:17 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6dac37f-e338-4eda-96a2-8894854d528b -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b.01ef80b3-6911-40d1-822f-7ac18012abd8 Sep 28 18:20:17 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:17 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-399ce5d0-6210-4139-b704-ab5bf6f641e0 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0911bbb1-e5f4-48af-b4a8-e86f90dc960b" returned: 0 in 0.541s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:17 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-399ce5d0-6210-4139-b704-ab5bf6f641e0 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-0911bbb1-e5f4-48af-b4a8-e86f90dc960b" released by "delete_volume" :: held 1.325s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:17 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-399ce5d0-6210-4139-b704-ab5bf6f641e0 tempest-VolumesSnapshotTestJSON-606072181 None] Created reservations ['1ac41838-2b2d-418a-86ca-82f8b04d2a97', '23609719-cba8-408b-8c44-cdceb6ddf361', '2c6ff9b6-9b3c-43c1-aba4-929ebb9cf3f8', '262523c5-f7e9-4725-a94b-ae57c8bb884e'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-399ce5d0-6210-4139-b704-ab5bf6f641e0 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-399ce5d0-6210-4139-b704-ab5bf6f641e0 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:17 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-399ce5d0-6210-4139-b704-ab5bf6f641e0 tempest-VolumesSnapshotTestJSON-606072181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:17 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-399ce5d0-6210-4139-b704-ab5bf6f641e0 tempest-VolumesSnapshotTestJSON-606072181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-399ce5d0-6210-4139-b704-ab5bf6f641e0 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-399ce5d0-6210-4139-b704-ab5bf6f641e0 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:17 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:20:17 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:17 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0107a576-3a31-4509-abf4-ab17c653dd89 tempest-SnapshotDependencyTests-408735362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6dac37f-e338-4eda-96a2-8894854d528b -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b.01ef80b3-6911-40d1-822f-7ac18012abd8" returned: 0 in 0.748s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:17 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-0107a576-3a31-4509-abf4-ab17c653dd89 tempest-SnapshotDependencyTests-408735362 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b.01ef80b3-6911-40d1-822f-7ac18012abd8 is being set with open permissions: ugo+rw Sep 28 18:20:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0107a576-3a31-4509-abf4-ab17c653dd89 tempest-SnapshotDependencyTests-408735362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b.01ef80b3-6911-40d1-822f-7ac18012abd8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:17 devstack sudo[102869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b.01ef80b3-6911-40d1-822f-7ac18012abd8 Sep 28 18:20:17 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:18 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-399ce5d0-6210-4139-b704-ab5bf6f641e0 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.376s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:18 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-399ce5d0-6210-4139-b704-ab5bf6f641e0 tempest-VolumesSnapshotTestJSON-606072181 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:18 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-399ce5d0-6210-4139-b704-ab5bf6f641e0 tempest-VolumesSnapshotTestJSON-606072181 None] Deleted volume successfully. Sep 28 18:20:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-399ce5d0-6210-4139-b704-ab5bf6f641e0 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-0911bbb1-e5f4-48af-b4a8-e86f90dc960b-delete_volume" released by "delete_volume" :: held 2.156s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:18 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0107a576-3a31-4509-abf4-ab17c653dd89 tempest-SnapshotDependencyTests-408735362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b.01ef80b3-6911-40d1-822f-7ac18012abd8" returned: 0 in 0.384s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0107a576-3a31-4509-abf4-ab17c653dd89 tempest-SnapshotDependencyTests-408735362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:18 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b.info Sep 28 18:20:18 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f872d01a-1975-4488-8724-cd2311825805 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "cinder-9f150bdd-9ef1-4415-a0cd-bbe9939ac99e-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f872d01a-1975-4488-8724-cd2311825805 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-9f150bdd-9ef1-4415-a0cd-bbe9939ac99e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f872d01a-1975-4488-8724-cd2311825805 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "cinder-quobyte-a3733b70-a398-4a17-94a8-88b672e07bc3" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f872d01a-1975-4488-8724-cd2311825805 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-a3733b70-a398-4a17-94a8-88b672e07bc3" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f872d01a-1975-4488-8724-cd2311825805 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "cinder-quobyte-9f150bdd-9ef1-4415-a0cd-bbe9939ac99e" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f872d01a-1975-4488-8724-cd2311825805 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-9f150bdd-9ef1-4415-a0cd-bbe9939ac99e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-f872d01a-1975-4488-8724-cd2311825805 tempest-VolumesSnapshotTestJSON-606072181 None] Deleting offline snapshot 9f150bdd-9ef1-4415-a0cd-bbe9939ac99e of volume a3733b70-a398-4a17-94a8-88b672e07bc3 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:20:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-f872d01a-1975-4488-8724-cd2311825805 tempest-VolumesSnapshotTestJSON-606072181 None] snapshot_file for this snap is: volume-a3733b70-a398-4a17-94a8-88b672e07bc3.9f150bdd-9ef1-4415-a0cd-bbe9939ac99e {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:20:18 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7fb5b6-093b-4ef3-927d-67c999c78e2a]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f872d01a-1975-4488-8724-cd2311825805 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3.9f150bdd-9ef1-4415-a0cd-bbe9939ac99e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:18 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0107a576-3a31-4509-abf4-ab17c653dd89 tempest-SnapshotDependencyTests-408735362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b.info" returned: 0 in 0.366s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:18 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-0107a576-3a31-4509-abf4-ab17c653dd89 tempest-SnapshotDependencyTests-408735362 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b.info is being set with open permissions: ugo+rw Sep 28 18:20:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0107a576-3a31-4509-abf4-ab17c653dd89 tempest-SnapshotDependencyTests-408735362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:18 devstack sudo[102881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b.info Sep 28 18:20:18 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:18 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3.9f150bdd-9ef1-4415-a0cd-bbe9939ac99e Sep 28 18:20:18 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:19 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0107a576-3a31-4509-abf4-ab17c653dd89 tempest-SnapshotDependencyTests-408735362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b.info" returned: 0 in 0.371s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0107a576-3a31-4509-abf4-ab17c653dd89 tempest-SnapshotDependencyTests-408735362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.613s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.404s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:19 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Acquiring lock "cinder-quobyte-e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3-bd67098d-c998-4dcd-85a4-35ef902f6d35" by "_create_volume_from_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:19 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Lock "cinder-quobyte-e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3-bd67098d-c998-4dcd-85a4-35ef902f6d35" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Creating volume bd67098d-c998-4dcd-85a4-35ef902f6d35 from snapshot e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3 {{(pid=86980) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:20:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:19 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Acquiring lock "cinder-quobyte-bd67098d-c998-4dcd-85a4-35ef902f6d35" by "_copy_volume_from_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:19 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-0107a576-3a31-4509-abf4-ab17c653dd89 tempest-SnapshotDependencyTests-408735362 None] Create snapshot completed successfully Sep 28 18:20:19 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Lock "cinder-quobyte-bd67098d-c998-4dcd-85a4-35ef902f6d35" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] snapshot: e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3, volume: bd67098d-c998-4dcd-85a4-35ef902f6d35, {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:20:19 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f872d01a-1975-4488-8724-cd2311825805 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3.9f150bdd-9ef1-4415-a0cd-bbe9939ac99e" returned: 0 in 0.653s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-f872d01a-1975-4488-8724-cd2311825805 tempest-VolumesSnapshotTestJSON-606072181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3733b70-a398-4a17-94a8-88b672e07bc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:20:19 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe5f56b-f757-435b-aade-94658b7cc512]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:19 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d7bd5d-1714-45d9-8f20-d31e9b209da7]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f872d01a-1975-4488-8724-cd2311825805 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:19 devstack sudo[102901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3 Sep 28 18:20:19 devstack sudo[102901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:19 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3 Sep 28 18:20:19 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:20 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3" returned: 0 in 0.791s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:20 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dab0d3e8-312a-46bb-8a02-ae93840ed026(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:20:20 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9cb58d-3088-4671-9537-2e2720857dad]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:20 devstack sudo[102901]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f872d01a-1975-4488-8724-cd2311825805 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3" returned: 0 in 0.864s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f872d01a-1975-4488-8724-cd2311825805 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3.9f150bdd-9ef1-4415-a0cd-bbe9939ac99e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:20 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3.9f150bdd-9ef1-4415-a0cd-bbe9939ac99e Sep 28 18:20:20 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:20 devstack sudo[102920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026 Sep 28 18:20:20 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:20 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026" returned: 0 in 0.603s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:20 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026 {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:20:20 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Creating direct copy from snapshot {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:20:20 devstack cinder-volume[86980]: DEBUG cinder.utils [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Path /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bd67098d-c998-4dcd-85a4-35ef902f6d35 not found in is_blk_device check {{(pid=86980) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:20:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bd67098d-c998-4dcd-85a4-35ef902f6d35 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:20 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bd67098d-c998-4dcd-85a4-35ef902f6d35 Sep 28 18:20:20 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:20 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f872d01a-1975-4488-8724-cd2311825805 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3.9f150bdd-9ef1-4415-a0cd-bbe9939ac99e" returned: 0 in 0.659s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f872d01a-1975-4488-8724-cd2311825805 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3.9f150bdd-9ef1-4415-a0cd-bbe9939ac99e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:20 devstack sudo[102949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3.9f150bdd-9ef1-4415-a0cd-bbe9939ac99e Sep 28 18:20:20 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:21 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Flow 'volume_create_manager' (86d3cd05-7e3a-479a-8b15-aac7a29e3c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3bf3d0c-24d7-4808-bc65-469c04baf8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3bf3d0c-24d7-4808-bc65-469c04baf8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac1db505-b4e1-456d-9eee-4a534ff25027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa3f5e3343e4c11aafc9241a6ab5e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=01ef80b3-6911-40d1-822f-7ac18012abd8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:21Z,use_quota=True,user_id='0a1fb7668d994c57a79b20e5cde66ff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eacc384-d2ee-46a7-9102-e7b30b49fb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eacc384-d2ee-46a7-9102-e7b30b49fb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (271163fb-b532-4c6b-a34a-434b07ac8421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (271163fb-b532-4c6b-a34a-434b07ac8421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ac1db505-b4e1-456d-9eee-4a534ff25027', 'volume_name': 'volume-ac1db505-b4e1-456d-9eee-4a534ff25027', 'volume_size': 1, 'snapshot_id': '01ef80b3-6911-40d1-822f-7ac18012abd8'}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a045faf-6076-452c-9e84-f2edda8dfd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a045faf-6076-452c-9e84-f2edda8dfd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45869e3d-808d-44f0-9836-a1b1bd45184a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:21 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Volume ac1db505-b4e1-456d-9eee-4a534ff25027: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ac1db505-b4e1-456d-9eee-4a534ff25027', 'volume_size': 1, 'snapshot_id': '01ef80b3-6911-40d1-822f-7ac18012abd8'} Sep 28 18:20:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:21 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f872d01a-1975-4488-8724-cd2311825805 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3.9f150bdd-9ef1-4415-a0cd-bbe9939ac99e" returned: 0 in 0.825s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:21 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f872d01a-1975-4488-8724-cd2311825805 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-9f150bdd-9ef1-4415-a0cd-bbe9939ac99e" released by "_delete_snapshot" :: held 3.195s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:21 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f872d01a-1975-4488-8724-cd2311825805 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-a3733b70-a398-4a17-94a8-88b672e07bc3" released by "delete_snapshot" :: held 3.225s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:21 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-f872d01a-1975-4488-8724-cd2311825805 tempest-VolumesSnapshotTestJSON-606072181 None] Created reservations ['9735c31d-eb01-4324-9a3a-6554475d02fe', '557c0708-9d81-44b5-a614-d2c92df30bca', '99cb0994-35a7-4fe6-bfbd-6aec60e7f3af', '0e36600f-180a-4e40-b6bb-687b587ef05f'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:21 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-f872d01a-1975-4488-8724-cd2311825805 tempest-VolumesSnapshotTestJSON-606072181 None] Delete snapshot completed successfully. Sep 28 18:20:22 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f872d01a-1975-4488-8724-cd2311825805 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-9f150bdd-9ef1-4415-a0cd-bbe9939ac99e-delete_snapshot" released by "delete_snapshot" :: held 3.517s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-afe52d32-fdf7-46d6-810e-982b18801de4 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "cinder-a3733b70-a398-4a17-94a8-88b672e07bc3-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-afe52d32-fdf7-46d6-810e-982b18801de4 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-a3733b70-a398-4a17-94a8-88b672e07bc3-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-afe52d32-fdf7-46d6-810e-982b18801de4 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "cinder-quobyte-a3733b70-a398-4a17-94a8-88b672e07bc3" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-afe52d32-fdf7-46d6-810e-982b18801de4 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-a3733b70-a398-4a17-94a8-88b672e07bc3" acquired by "delete_volume" :: waited 0.059s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:23 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9205e6ec-727e-445c-8405-1ca151a708ff]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-afe52d32-fdf7-46d6-810e-982b18801de4 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:24 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3 Sep 28 18:20:24 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:24 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-afe52d32-fdf7-46d6-810e-982b18801de4 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3" returned: 0 in 1.338s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-afe52d32-fdf7-46d6-810e-982b18801de4 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:25 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3 Sep 28 18:20:25 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:26 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-afe52d32-fdf7-46d6-810e-982b18801de4 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a3733b70-a398-4a17-94a8-88b672e07bc3" returned: 0 in 1.113s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:26 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-afe52d32-fdf7-46d6-810e-982b18801de4 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-a3733b70-a398-4a17-94a8-88b672e07bc3" released by "delete_volume" :: held 2.669s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:26 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-afe52d32-fdf7-46d6-810e-982b18801de4 tempest-VolumesSnapshotTestJSON-606072181 None] Created reservations ['db4b6a25-4072-4d26-a18a-85adbd2c0f27', '28fd16e4-d37f-4401-9bc6-2b1008fb9e91', '7e19ca62-25fe-4c74-8210-7cc63570c7e2', '4f81705d-d6c7-4853-b61a-2306b08dabc6'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-afe52d32-fdf7-46d6-810e-982b18801de4 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-afe52d32-fdf7-46d6-810e-982b18801de4 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:26 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-afe52d32-fdf7-46d6-810e-982b18801de4 tempest-VolumesSnapshotTestJSON-606072181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:26 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-afe52d32-fdf7-46d6-810e-982b18801de4 tempest-VolumesSnapshotTestJSON-606072181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-afe52d32-fdf7-46d6-810e-982b18801de4 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-afe52d32-fdf7-46d6-810e-982b18801de4 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:26 devstack sudo[103016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:20:26 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:27 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-afe52d32-fdf7-46d6-810e-982b18801de4 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.678s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:27 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-afe52d32-fdf7-46d6-810e-982b18801de4 tempest-VolumesSnapshotTestJSON-606072181 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:27 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-afe52d32-fdf7-46d6-810e-982b18801de4 tempest-VolumesSnapshotTestJSON-606072181 None] Deleted volume successfully. Sep 28 18:20:27 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-afe52d32-fdf7-46d6-810e-982b18801de4 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-a3733b70-a398-4a17-94a8-88b672e07bc3-delete_volume" released by "delete_volume" :: held 4.002s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:29 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Flow 'volume_create_manager' (5984ba60-7ca8-42fa-b982-fb439a16edef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96734b9-90f6-482c-bc86-222c4fe5a8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96734b9-90f6-482c-bc86-222c4fe5a8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-868289471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9142a702077d4e5abdbd6b04ecccedff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:29Z,use_quota=True,user_id='34ceac2571c34115b1bd28d6ba4fb6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bce956-93c7-4205-a745-a25b33df8f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bce956-93c7-4205-a745-a25b33df8f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e5ea90-39ec-42a4-9975-51b99cefb21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e5ea90-39ec-42a4-9975-51b99cefb21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7', 'volume_name': 'volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (522c767d-dcfa-40df-a6ac-b8606a7ed97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (522c767d-dcfa-40df-a6ac-b8606a7ed97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726988ab-14c4-4df4-bcfd-d72aa2c90103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:29 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Volume c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7', 'volume_size': 1} Sep 28 18:20:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:32 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bd67098d-c998-4dcd-85a4-35ef902f6d35" returned: 0 in 12.056s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:32 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Image conversion details: src /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026, size 1024.00 MB, duration 12.06 sec, destination /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bd67098d-c998-4dcd-85a4-35ef902f6d35 {{(pid=86980) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:20:32 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Converted 1024.00 MB image at 84.91 MB/s Sep 28 18:20:32 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bd67098d-c998-4dcd-85a4-35ef902f6d35 is being set with open permissions: ugo+rw Sep 28 18:20:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bd67098d-c998-4dcd-85a4-35ef902f6d35 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:32 devstack sudo[103037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bd67098d-c998-4dcd-85a4-35ef902f6d35 Sep 28 18:20:32 devstack sudo[103037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:33 devstack sudo[103037]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bd67098d-c998-4dcd-85a4-35ef902f6d35" returned: 0 in 0.290s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Lock "cinder-quobyte-bd67098d-c998-4dcd-85a4-35ef902f6d35" released by "_copy_volume_from_snapshot" :: held 13.924s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Lock "cinder-quobyte-e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3-bd67098d-c998-4dcd-85a4-35ef902f6d35" released by "_create_volume_from_snapshot" :: held 14.034s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.076s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 11.547s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Acquiring lock "cinder-quobyte-01ef80b3-6911-40d1-822f-7ac18012abd8-ac1db505-b4e1-456d-9eee-4a534ff25027" by "_create_volume_from_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb8722c-9e1f-4f13-8cda-57a0b8c5bde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd67098d-c998-4dcd-85a4-35ef902f6d35', 'volume_size': 1, 'snapshot_id': 'e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3'}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6019f632-817e-4a20-aaa7-99740d2bbb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Lock "cinder-quobyte-01ef80b3-6911-40d1-822f-7ac18012abd8-ac1db505-b4e1-456d-9eee-4a534ff25027" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Creating volume ac1db505-b4e1-456d-9eee-4a534ff25027 from snapshot 01ef80b3-6911-40d1-822f-7ac18012abd8 {{(pid=86980) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Acquiring lock "cinder-quobyte-ac1db505-b4e1-456d-9eee-4a534ff25027" by "_copy_volume_from_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:33 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Volume volume-bd67098d-c998-4dcd-85a4-35ef902f6d35 (bd67098d-c998-4dcd-85a4-35ef902f6d35): created successfully Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6019f632-817e-4a20-aaa7-99740d2bbb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Flow 'volume_create_manager' (05e8faf9-24c3-4fe7-8e56-e49ca9c3b78d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Lock "cinder-quobyte-ac1db505-b4e1-456d-9eee-4a534ff25027" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] snapshot: 01ef80b3-6911-40d1-822f-7ac18012abd8, volume: ac1db505-b4e1-456d-9eee-4a534ff25027, {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:33 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-6610872e-901a-4e89-ac49-99fe096f9c7b tempest-TestStampPattern-57928506 None] Created volume successfully. Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e971a309-8710-4262-8a17-decac5c9d8a5]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b.01ef80b3-6911-40d1-822f-7ac18012abd8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:33 devstack sudo[103040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b.01ef80b3-6911-40d1-822f-7ac18012abd8 Sep 28 18:20:33 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:33 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b.01ef80b3-6911-40d1-822f-7ac18012abd8" returned: 0 in 0.480s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6dac37f-e338-4eda-96a2-8894854d528b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb671077-c739-44b9-ad73-4ebb90adb50e]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:33 devstack sudo[103046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b Sep 28 18:20:33 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:34 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b" returned: 0 in 0.519s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:34 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:20:34 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Creating direct copy from snapshot {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:20:34 devstack cinder-volume[86980]: DEBUG cinder.utils [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Path /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ac1db505-b4e1-456d-9eee-4a534ff25027 not found in is_blk_device check {{(pid=86980) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:20:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ac1db505-b4e1-456d-9eee-4a534ff25027 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:34 devstack sudo[103054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ac1db505-b4e1-456d-9eee-4a534ff25027 Sep 28 18:20:34 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:41 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ac1db505-b4e1-456d-9eee-4a534ff25027" returned: 0 in 7.016s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:41 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Image conversion details: src /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b, size 1024.00 MB, duration 7.02 sec, destination /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ac1db505-b4e1-456d-9eee-4a534ff25027 {{(pid=86980) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:20:41 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Converted 1024.00 MB image at 145.92 MB/s Sep 28 18:20:41 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ac1db505-b4e1-456d-9eee-4a534ff25027 is being set with open permissions: ugo+rw Sep 28 18:20:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ac1db505-b4e1-456d-9eee-4a534ff25027 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:41 devstack sudo[103085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ac1db505-b4e1-456d-9eee-4a534ff25027 Sep 28 18:20:41 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:41 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ac1db505-b4e1-456d-9eee-4a534ff25027" returned: 0 in 0.301s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Lock "cinder-quobyte-ac1db505-b4e1-456d-9eee-4a534ff25027" released by "_copy_volume_from_snapshot" :: held 8.451s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Lock "cinder-quobyte-01ef80b3-6911-40d1-822f-7ac18012abd8-ac1db505-b4e1-456d-9eee-4a534ff25027" released by "_create_volume_from_snapshot" :: held 8.552s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.594s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.913s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:41 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-868289471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9142a702077d4e5abdbd6b04ecccedff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:29Z,use_quota=True,user_id='34ceac2571c34115b1bd28d6ba4fb6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:20:41 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Creating volume c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:20:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:41 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:41 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:41 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:41 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:20:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:41 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7 1073741824 Sep 28 18:20:41 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45869e3d-808d-44f0-9836-a1b1bd45184a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac1db505-b4e1-456d-9eee-4a534ff25027', 'volume_size': 1, 'snapshot_id': '01ef80b3-6911-40d1-822f-7ac18012abd8'}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b48c1bc0-1592-44ca-a71c-2854d8ebeec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:41 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Volume volume-ac1db505-b4e1-456d-9eee-4a534ff25027 (ac1db505-b4e1-456d-9eee-4a534ff25027): created successfully Sep 28 18:20:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b48c1bc0-1592-44ca-a71c-2854d8ebeec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Flow 'volume_create_manager' (86d3cd05-7e3a-479a-8b15-aac7a29e3c95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:41 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-57a48191-004d-4253-9a74-1297a1944ba5 tempest-SnapshotDependencyTests-408735362 None] Created volume successfully. Sep 28 18:20:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-98835407-f60b-433f-86c0-3f9f1f762ba1 tempest-SnapshotDependencyTests-408735362 None] Acquiring lock "cinder-01ef80b3-6911-40d1-822f-7ac18012abd8-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-98835407-f60b-433f-86c0-3f9f1f762ba1 tempest-SnapshotDependencyTests-408735362 None] Lock "cinder-01ef80b3-6911-40d1-822f-7ac18012abd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-98835407-f60b-433f-86c0-3f9f1f762ba1 tempest-SnapshotDependencyTests-408735362 None] Acquiring lock "cinder-quobyte-d6dac37f-e338-4eda-96a2-8894854d528b" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-98835407-f60b-433f-86c0-3f9f1f762ba1 tempest-SnapshotDependencyTests-408735362 None] Lock "cinder-quobyte-d6dac37f-e338-4eda-96a2-8894854d528b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-98835407-f60b-433f-86c0-3f9f1f762ba1 tempest-SnapshotDependencyTests-408735362 None] Acquiring lock "cinder-quobyte-01ef80b3-6911-40d1-822f-7ac18012abd8" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-98835407-f60b-433f-86c0-3f9f1f762ba1 tempest-SnapshotDependencyTests-408735362 None] Lock "cinder-quobyte-01ef80b3-6911-40d1-822f-7ac18012abd8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-98835407-f60b-433f-86c0-3f9f1f762ba1 tempest-SnapshotDependencyTests-408735362 None] Deleting offline snapshot 01ef80b3-6911-40d1-822f-7ac18012abd8 of volume d6dac37f-e338-4eda-96a2-8894854d528b {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:20:42 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-98835407-f60b-433f-86c0-3f9f1f762ba1 tempest-SnapshotDependencyTests-408735362 None] snapshot_file for this snap is: volume-d6dac37f-e338-4eda-96a2-8894854d528b.01ef80b3-6911-40d1-822f-7ac18012abd8 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:20:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7 1073741824" returned: 0 in 0.596s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:42 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edb8085-53c9-46d4-99e8-87779475281e]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-98835407-f60b-433f-86c0-3f9f1f762ba1 tempest-SnapshotDependencyTests-408735362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b.01ef80b3-6911-40d1-822f-7ac18012abd8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:42 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7 Sep 28 18:20:42 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:42 devstack sudo[103094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b.01ef80b3-6911-40d1-822f-7ac18012abd8 Sep 28 18:20:42 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:42 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7" returned: 0 in 0.275s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:20:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:42 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726988ab-14c4-4df4-bcfd-d72aa2c90103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:42 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b32e84b4-7d37-41a2-a286-186148dd5408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:42 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Volume volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7 (c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7): created successfully Sep 28 18:20:42 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b32e84b4-7d37-41a2-a286-186148dd5408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:42 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Flow 'volume_create_manager' (5984ba60-7ca8-42fa-b982-fb439a16edef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:42 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-63ca8e54-742d-4866-bc57-f3cfac77566a tempest-VolumesSnapshotTestJSON-606072181 None] Created volume successfully. Sep 28 18:20:42 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-98835407-f60b-433f-86c0-3f9f1f762ba1 tempest-SnapshotDependencyTests-408735362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b.01ef80b3-6911-40d1-822f-7ac18012abd8" returned: 0 in 0.414s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-98835407-f60b-433f-86c0-3f9f1f762ba1 tempest-SnapshotDependencyTests-408735362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6dac37f-e338-4eda-96a2-8894854d528b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:20:42 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad4c5b1-b794-4cf4-875c-44d6e64578e0]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-98835407-f60b-433f-86c0-3f9f1f762ba1 tempest-SnapshotDependencyTests-408735362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:42 devstack sudo[103105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b Sep 28 18:20:42 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:43 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-98835407-f60b-433f-86c0-3f9f1f762ba1 tempest-SnapshotDependencyTests-408735362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b" returned: 0 in 0.553s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-98835407-f60b-433f-86c0-3f9f1f762ba1 tempest-SnapshotDependencyTests-408735362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b.01ef80b3-6911-40d1-822f-7ac18012abd8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:43 devstack sudo[103110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b.01ef80b3-6911-40d1-822f-7ac18012abd8 Sep 28 18:20:43 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:43 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-98835407-f60b-433f-86c0-3f9f1f762ba1 tempest-SnapshotDependencyTests-408735362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b.01ef80b3-6911-40d1-822f-7ac18012abd8" returned: 0 in 0.417s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-98835407-f60b-433f-86c0-3f9f1f762ba1 tempest-SnapshotDependencyTests-408735362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b.01ef80b3-6911-40d1-822f-7ac18012abd8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:43 devstack sudo[103115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b.01ef80b3-6911-40d1-822f-7ac18012abd8 Sep 28 18:20:43 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:43 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=68,cinder:UPDATE=58,cinder:INSERT=14,cinder:DELETE=5 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:20:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-49c00a60-3c27-4f63-ae7d-f55c09e4db77 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-49c00a60-3c27-4f63-ae7d-f55c09e4db77 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-49c00a60-3c27-4f63-ae7d-f55c09e4db77 tempest-VolumesSnapshotTestJSON-606072181 None] Creating offline snapshot 0da36aa9-5081-4c3a-ab7d-82a189c0d45c of volume c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:20:43 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff7e4a8-f546-4fd0-b02a-fef6918635cc]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-49c00a60-3c27-4f63-ae7d-f55c09e4db77 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:44 devstack sudo[103117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7 Sep 28 18:20:44 devstack sudo[103117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:44 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-98835407-f60b-433f-86c0-3f9f1f762ba1 tempest-SnapshotDependencyTests-408735362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b.01ef80b3-6911-40d1-822f-7ac18012abd8" returned: 0 in 0.316s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:44 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=70,cinder:UPDATE=56,cinder:DELETE=8,cinder:INSERT=13 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:20:44 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-98835407-f60b-433f-86c0-3f9f1f762ba1 tempest-SnapshotDependencyTests-408735362 None] Lock "cinder-quobyte-01ef80b3-6911-40d1-822f-7ac18012abd8" released by "_delete_snapshot" :: held 1.833s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:44 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-98835407-f60b-433f-86c0-3f9f1f762ba1 tempest-SnapshotDependencyTests-408735362 None] Lock "cinder-quobyte-d6dac37f-e338-4eda-96a2-8894854d528b" released by "delete_snapshot" :: held 1.863s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:44 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-98835407-f60b-433f-86c0-3f9f1f762ba1 tempest-SnapshotDependencyTests-408735362 None] Created reservations ['8ad4482c-33f5-4d7c-a194-d1d1aaa9b0f2', 'd57bf415-46c9-44af-ac8e-aac3d3721a12', 'c966069e-a3ef-4e73-85f5-beca2051fd51', '8d70d898-e738-473e-ace1-57411f3804b8'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:44 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-98835407-f60b-433f-86c0-3f9f1f762ba1 tempest-SnapshotDependencyTests-408735362 None] Delete snapshot completed successfully. Sep 28 18:20:44 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-98835407-f60b-433f-86c0-3f9f1f762ba1 tempest-SnapshotDependencyTests-408735362 None] Lock "cinder-01ef80b3-6911-40d1-822f-7ac18012abd8-delete_snapshot" released by "delete_snapshot" :: held 2.083s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:44 devstack sudo[103117]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-49c00a60-3c27-4f63-ae7d-f55c09e4db77 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7" returned: 0 in 0.506s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-49c00a60-3c27-4f63-ae7d-f55c09e4db77 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.0da36aa9-5081-4c3a-ab7d-82a189c0d45c 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:44 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.0da36aa9-5081-4c3a-ab7d-82a189c0d45c 1G Sep 28 18:20:44 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:44 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-846dd847-b7e8-4f73-a79e-ccde4ab8480e tempest-SnapshotDependencyTests-408735362 None] Acquiring lock "cinder-d6dac37f-e338-4eda-96a2-8894854d528b-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:44 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-846dd847-b7e8-4f73-a79e-ccde4ab8480e tempest-SnapshotDependencyTests-408735362 None] Lock "cinder-d6dac37f-e338-4eda-96a2-8894854d528b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:44 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-846dd847-b7e8-4f73-a79e-ccde4ab8480e tempest-SnapshotDependencyTests-408735362 None] Acquiring lock "cinder-quobyte-d6dac37f-e338-4eda-96a2-8894854d528b" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:44 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-846dd847-b7e8-4f73-a79e-ccde4ab8480e tempest-SnapshotDependencyTests-408735362 None] Lock "cinder-quobyte-d6dac37f-e338-4eda-96a2-8894854d528b" acquired by "delete_volume" :: waited 0.024s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:44 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7ebd3a-e294-41e8-9926-b5f2e51b1d81]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-846dd847-b7e8-4f73-a79e-ccde4ab8480e tempest-SnapshotDependencyTests-408735362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:44 devstack sudo[103125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b Sep 28 18:20:44 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:44 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-49c00a60-3c27-4f63-ae7d-f55c09e4db77 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.0da36aa9-5081-4c3a-ab7d-82a189c0d45c 1G" returned: 0 in 0.515s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-49c00a60-3c27-4f63-ae7d-f55c09e4db77 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.0da36aa9-5081-4c3a-ab7d-82a189c0d45c {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:44 devstack sudo[103131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.0da36aa9-5081-4c3a-ab7d-82a189c0d45c Sep 28 18:20:44 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:45 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-846dd847-b7e8-4f73-a79e-ccde4ab8480e tempest-SnapshotDependencyTests-408735362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b" returned: 0 in 0.484s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-846dd847-b7e8-4f73-a79e-ccde4ab8480e tempest-SnapshotDependencyTests-408735362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:45 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b Sep 28 18:20:45 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:45 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-49c00a60-3c27-4f63-ae7d-f55c09e4db77 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.0da36aa9-5081-4c3a-ab7d-82a189c0d45c" returned: 0 in 0.321s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:45 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-49c00a60-3c27-4f63-ae7d-f55c09e4db77 tempest-VolumesSnapshotTestJSON-606072181 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.0da36aa9-5081-4c3a-ab7d-82a189c0d45c is being set with open permissions: ugo+rw Sep 28 18:20:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-49c00a60-3c27-4f63-ae7d-f55c09e4db77 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.0da36aa9-5081-4c3a-ab7d-82a189c0d45c {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:45 devstack sudo[103141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.0da36aa9-5081-4c3a-ab7d-82a189c0d45c Sep 28 18:20:45 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:45 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-846dd847-b7e8-4f73-a79e-ccde4ab8480e tempest-SnapshotDependencyTests-408735362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d6dac37f-e338-4eda-96a2-8894854d528b" returned: 0 in 0.281s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:45 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-846dd847-b7e8-4f73-a79e-ccde4ab8480e tempest-SnapshotDependencyTests-408735362 None] Lock "cinder-quobyte-d6dac37f-e338-4eda-96a2-8894854d528b" released by "delete_volume" :: held 0.850s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:45 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-846dd847-b7e8-4f73-a79e-ccde4ab8480e tempest-SnapshotDependencyTests-408735362 None] Created reservations ['f45ad9f0-2fc1-4960-8b08-030d26e449fd', 'fb0b7e5a-8c27-4f7d-86b3-87e7cf17fe9a', '28e9a375-4b1c-4170-8f2b-7a1b46840c6e', '0d9d54ab-92df-4df9-8f0c-d7b3e0213141'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:45 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-49c00a60-3c27-4f63-ae7d-f55c09e4db77 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.0da36aa9-5081-4c3a-ab7d-82a189c0d45c" returned: 0 in 0.291s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-49c00a60-3c27-4f63-ae7d-f55c09e4db77 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-846dd847-b7e8-4f73-a79e-ccde4ab8480e tempest-SnapshotDependencyTests-408735362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-846dd847-b7e8-4f73-a79e-ccde4ab8480e tempest-SnapshotDependencyTests-408735362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:45 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-846dd847-b7e8-4f73-a79e-ccde4ab8480e tempest-SnapshotDependencyTests-408735362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:45 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-846dd847-b7e8-4f73-a79e-ccde4ab8480e tempest-SnapshotDependencyTests-408735362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-846dd847-b7e8-4f73-a79e-ccde4ab8480e tempest-SnapshotDependencyTests-408735362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-846dd847-b7e8-4f73-a79e-ccde4ab8480e tempest-SnapshotDependencyTests-408735362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:45 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.info Sep 28 18:20:45 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:45 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:20:45 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:45 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ae738c11-3da4-461b-a360-c87bcfeb944d tempest-SnapshotDependencyTests-408735362 None] Acquiring lock "cinder-ac1db505-b4e1-456d-9eee-4a534ff25027-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:45 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ae738c11-3da4-461b-a360-c87bcfeb944d tempest-SnapshotDependencyTests-408735362 None] Lock "cinder-ac1db505-b4e1-456d-9eee-4a534ff25027-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:45 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ae738c11-3da4-461b-a360-c87bcfeb944d tempest-SnapshotDependencyTests-408735362 None] Acquiring lock "cinder-quobyte-ac1db505-b4e1-456d-9eee-4a534ff25027" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:45 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ae738c11-3da4-461b-a360-c87bcfeb944d tempest-SnapshotDependencyTests-408735362 None] Lock "cinder-quobyte-ac1db505-b4e1-456d-9eee-4a534ff25027" acquired by "delete_volume" :: waited 0.024s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:45 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd46e96-84dd-4087-9ebf-a6f6ff00fea6]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ae738c11-3da4-461b-a360-c87bcfeb944d tempest-SnapshotDependencyTests-408735362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ac1db505-b4e1-456d-9eee-4a534ff25027 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:45 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-846dd847-b7e8-4f73-a79e-ccde4ab8480e tempest-SnapshotDependencyTests-408735362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.314s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:45 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-846dd847-b7e8-4f73-a79e-ccde4ab8480e tempest-SnapshotDependencyTests-408735362 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:45 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-846dd847-b7e8-4f73-a79e-ccde4ab8480e tempest-SnapshotDependencyTests-408735362 None] Deleted volume successfully. Sep 28 18:20:45 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-49c00a60-3c27-4f63-ae7d-f55c09e4db77 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.info" returned: 0 in 0.401s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:46 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-49c00a60-3c27-4f63-ae7d-f55c09e4db77 tempest-VolumesSnapshotTestJSON-606072181 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.info is being set with open permissions: ugo+rw Sep 28 18:20:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-49c00a60-3c27-4f63-ae7d-f55c09e4db77 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:46 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-846dd847-b7e8-4f73-a79e-ccde4ab8480e tempest-SnapshotDependencyTests-408735362 None] Lock "cinder-d6dac37f-e338-4eda-96a2-8894854d528b-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:46 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ac1db505-b4e1-456d-9eee-4a534ff25027 Sep 28 18:20:46 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:46 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.info Sep 28 18:20:46 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:46 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:46 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-49c00a60-3c27-4f63-ae7d-f55c09e4db77 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.info" returned: 0 in 0.313s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-49c00a60-3c27-4f63-ae7d-f55c09e4db77 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.490s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ae738c11-3da4-461b-a360-c87bcfeb944d tempest-SnapshotDependencyTests-408735362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ac1db505-b4e1-456d-9eee-4a534ff25027" returned: 0 in 0.466s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ae738c11-3da4-461b-a360-c87bcfeb944d tempest-SnapshotDependencyTests-408735362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ac1db505-b4e1-456d-9eee-4a534ff25027 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:46 devstack sudo[103161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ac1db505-b4e1-456d-9eee-4a534ff25027 Sep 28 18:20:46 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:46 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-49c00a60-3c27-4f63-ae7d-f55c09e4db77 tempest-VolumesSnapshotTestJSON-606072181 None] Create snapshot completed successfully Sep 28 18:20:46 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ae738c11-3da4-461b-a360-c87bcfeb944d tempest-SnapshotDependencyTests-408735362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ac1db505-b4e1-456d-9eee-4a534ff25027" returned: 0 in 0.293s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:46 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ae738c11-3da4-461b-a360-c87bcfeb944d tempest-SnapshotDependencyTests-408735362 None] Lock "cinder-quobyte-ac1db505-b4e1-456d-9eee-4a534ff25027" released by "delete_volume" :: held 0.835s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:46 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-ae738c11-3da4-461b-a360-c87bcfeb944d tempest-SnapshotDependencyTests-408735362 None] Created reservations ['67c714e1-2eff-4a6b-ba0e-a8a25a1c2254', '751974ad-8477-4ea8-91e3-efb92b49d238', '493080f7-6dae-4193-9fb6-0cb039593576', '2eddc96e-0425-48a3-bd0e-7230efebad78'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:20:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ae738c11-3da4-461b-a360-c87bcfeb944d tempest-SnapshotDependencyTests-408735362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ae738c11-3da4-461b-a360-c87bcfeb944d tempest-SnapshotDependencyTests-408735362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:46 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ae738c11-3da4-461b-a360-c87bcfeb944d tempest-SnapshotDependencyTests-408735362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:46 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ae738c11-3da4-461b-a360-c87bcfeb944d tempest-SnapshotDependencyTests-408735362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ae738c11-3da4-461b-a360-c87bcfeb944d tempest-SnapshotDependencyTests-408735362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ae738c11-3da4-461b-a360-c87bcfeb944d tempest-SnapshotDependencyTests-408735362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:46 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:20:46 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:47 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ae738c11-3da4-461b-a360-c87bcfeb944d tempest-SnapshotDependencyTests-408735362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.306s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-ae738c11-3da4-461b-a360-c87bcfeb944d tempest-SnapshotDependencyTests-408735362 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:20:47 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-ae738c11-3da4-461b-a360-c87bcfeb944d tempest-SnapshotDependencyTests-408735362 None] Deleted volume successfully. Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ae738c11-3da4-461b-a360-c87bcfeb944d tempest-SnapshotDependencyTests-408735362 None] Lock "cinder-ac1db505-b4e1-456d-9eee-4a534ff25027-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Flow 'volume_create_manager' (a11b6964-45c3-4d55-9509-0c87adf853a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bfdc803-fa41-44d1-b3f9-83673098586d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bfdc803-fa41-44d1-b3f9-83673098586d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1540870850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55336c33-2980-44a5-b3ee-aca1a26ca894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9142a702077d4e5abdbd6b04ecccedff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0da36aa9-5081-4c3a-ab7d-82a189c0d45c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:20:48Z,use_quota=True,user_id='34ceac2571c34115b1bd28d6ba4fb6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81bef7e3-71a8-4818-9bfe-8e3e5c306adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81bef7e3-71a8-4818-9bfe-8e3e5c306adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ee3b40-1a42-4978-8f05-e1a3127e3dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ee3b40-1a42-4978-8f05-e1a3127e3dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '55336c33-2980-44a5-b3ee-aca1a26ca894', 'volume_name': 'volume-55336c33-2980-44a5-b3ee-aca1a26ca894', 'volume_size': 1, 'snapshot_id': '0da36aa9-5081-4c3a-ab7d-82a189c0d45c'}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9229a02-a591-4301-8572-dc32761e3a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9229a02-a591-4301-8572-dc32761e3a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9106c11b-100c-43fb-b667-c42f0cab23fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:47 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Volume 55336c33-2980-44a5-b3ee-aca1a26ca894: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-55336c33-2980-44a5-b3ee-aca1a26ca894', 'volume_size': 1, 'snapshot_id': '0da36aa9-5081-4c3a-ab7d-82a189c0d45c'} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "cinder-quobyte-0da36aa9-5081-4c3a-ab7d-82a189c0d45c-55336c33-2980-44a5-b3ee-aca1a26ca894" by "_create_volume_from_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-0da36aa9-5081-4c3a-ab7d-82a189c0d45c-55336c33-2980-44a5-b3ee-aca1a26ca894" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Creating volume 55336c33-2980-44a5-b3ee-aca1a26ca894 from snapshot 0da36aa9-5081-4c3a-ab7d-82a189c0d45c {{(pid=86980) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "cinder-quobyte-55336c33-2980-44a5-b3ee-aca1a26ca894" by "_copy_volume_from_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-55336c33-2980-44a5-b3ee-aca1a26ca894" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] snapshot: 0da36aa9-5081-4c3a-ab7d-82a189c0d45c, volume: 55336c33-2980-44a5-b3ee-aca1a26ca894, {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2a7077-5bae-439b-8ffa-aa90acd27728]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.0da36aa9-5081-4c3a-ab7d-82a189c0d45c {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:48 devstack sudo[103167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.0da36aa9-5081-4c3a-ab7d-82a189c0d45c Sep 28 18:20:48 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:48 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.0da36aa9-5081-4c3a-ab7d-82a189c0d45c" returned: 0 in 0.487s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:48 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:20:48 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04631fa-db03-427d-8f4e-3a1d2c8812e8]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:48 devstack sudo[103173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7 Sep 28 18:20:48 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:48 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7" returned: 0 in 0.425s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:48 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7 {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:20:48 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Creating direct copy from snapshot {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:20:48 devstack cinder-volume[86980]: DEBUG cinder.utils [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Path /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55336c33-2980-44a5-b3ee-aca1a26ca894 not found in is_blk_device check {{(pid=86980) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:20:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55336c33-2980-44a5-b3ee-aca1a26ca894 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:48 devstack sudo[103178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55336c33-2980-44a5-b3ee-aca1a26ca894 Sep 28 18:20:48 devstack sudo[103178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-8a1b52bc-a6bf-41e6-a69c-86e3af74703c req-a4eeb6c4-2fcc-4be7-9d52-7930c92ab2ce tempest-TestStampPattern-57928506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:20:57 devstack sudo[103178]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55336c33-2980-44a5-b3ee-aca1a26ca894" returned: 0 in 8.670s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:57 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Image conversion details: src /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7, size 1024.00 MB, duration 8.67 sec, destination /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55336c33-2980-44a5-b3ee-aca1a26ca894 {{(pid=86980) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:20:57 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Converted 1024.00 MB image at 118.09 MB/s Sep 28 18:20:57 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55336c33-2980-44a5-b3ee-aca1a26ca894 is being set with open permissions: ugo+rw Sep 28 18:20:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55336c33-2980-44a5-b3ee-aca1a26ca894 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:57 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55336c33-2980-44a5-b3ee-aca1a26ca894 Sep 28 18:20:57 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:57 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55336c33-2980-44a5-b3ee-aca1a26ca894" returned: 0 in 0.320s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:57 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-55336c33-2980-44a5-b3ee-aca1a26ca894" released by "_copy_volume_from_snapshot" :: held 10.012s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:57 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-0da36aa9-5081-4c3a-ab7d-82a189c0d45c-55336c33-2980-44a5-b3ee-aca1a26ca894" released by "_create_volume_from_snapshot" :: held 10.091s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:20:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.108s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-8a1b52bc-a6bf-41e6-a69c-86e3af74703c req-a4eeb6c4-2fcc-4be7-9d52-7930c92ab2ce tempest-TestStampPattern-57928506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.560s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:20:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-8a1b52bc-a6bf-41e6-a69c-86e3af74703c req-a4eeb6c4-2fcc-4be7-9d52-7930c92ab2ce tempest-TestStampPattern-57928506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:20:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9106c11b-100c-43fb-b667-c42f0cab23fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55336c33-2980-44a5-b3ee-aca1a26ca894', 'volume_size': 1, 'snapshot_id': '0da36aa9-5081-4c3a-ab7d-82a189c0d45c'}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f5d456-41dd-4a47-a47f-c13c8c79a63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:20:58 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Volume volume-55336c33-2980-44a5-b3ee-aca1a26ca894 (55336c33-2980-44a5-b3ee-aca1a26ca894): created successfully Sep 28 18:20:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f5d456-41dd-4a47-a47f-c13c8c79a63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:20:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Flow 'volume_create_manager' (a11b6964-45c3-4d55-9509-0c87adf853a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:20:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-8a1b52bc-a6bf-41e6-a69c-86e3af74703c req-a4eeb6c4-2fcc-4be7-9d52-7930c92ab2ce tempest-TestStampPattern-57928506 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729', 'name': 'volume-bd67098d-c998-4dcd-85a4-35ef902f6d35', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3460f5e5-26d9-417d-b6ec-85669b9fff39', 'enforce_multipath': True} {{(pid=86980) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:20:58 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-0b133031-ea5c-4474-850f-681a4c8382fd tempest-VolumesSnapshotTestJSON-606072181 None] Created volume successfully. Sep 28 18:20:58 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-8a1b52bc-a6bf-41e6-a69c-86e3af74703c req-a4eeb6c4-2fcc-4be7-9d52-7930c92ab2ce tempest-TestStampPattern-57928506 None] attachment_update completed successfully. Sep 28 18:20:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a1a65ccd-194d-4944-bfed-7aa67e1ebcf9 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "cinder-55336c33-2980-44a5-b3ee-aca1a26ca894-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a1a65ccd-194d-4944-bfed-7aa67e1ebcf9 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-55336c33-2980-44a5-b3ee-aca1a26ca894-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a1a65ccd-194d-4944-bfed-7aa67e1ebcf9 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "cinder-quobyte-55336c33-2980-44a5-b3ee-aca1a26ca894" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:20:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a1a65ccd-194d-4944-bfed-7aa67e1ebcf9 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-55336c33-2980-44a5-b3ee-aca1a26ca894" acquired by "delete_volume" :: waited 0.020s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:20:59 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74c79b4-7e77-4de0-bf02-eaf2b1780c54]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:20:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a1a65ccd-194d-4944-bfed-7aa67e1ebcf9 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55336c33-2980-44a5-b3ee-aca1a26ca894 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:59 devstack sudo[103631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55336c33-2980-44a5-b3ee-aca1a26ca894 Sep 28 18:20:59 devstack sudo[103631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:20:59 devstack sudo[103631]: pam_unix(sudo:session): session closed for user root Sep 28 18:20:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a1a65ccd-194d-4944-bfed-7aa67e1ebcf9 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55336c33-2980-44a5-b3ee-aca1a26ca894" returned: 0 in 0.565s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:20:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a1a65ccd-194d-4944-bfed-7aa67e1ebcf9 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55336c33-2980-44a5-b3ee-aca1a26ca894 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:20:59 devstack sudo[103672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55336c33-2980-44a5-b3ee-aca1a26ca894 Sep 28 18:20:59 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:00 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a1a65ccd-194d-4944-bfed-7aa67e1ebcf9 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-55336c33-2980-44a5-b3ee-aca1a26ca894" returned: 0 in 0.270s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a1a65ccd-194d-4944-bfed-7aa67e1ebcf9 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-55336c33-2980-44a5-b3ee-aca1a26ca894" released by "delete_volume" :: held 0.934s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:00 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-a1a65ccd-194d-4944-bfed-7aa67e1ebcf9 tempest-VolumesSnapshotTestJSON-606072181 None] Created reservations ['f5ad4f60-2231-4230-a2b9-17fd39b93285', '904c15d7-cd98-446b-b1ed-7bde8b89d09d', '35c3c233-51fb-45f9-acd6-12bae2e1a004', '116885c2-2100-4f01-9375-8639fd2d8b3d'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a1a65ccd-194d-4944-bfed-7aa67e1ebcf9 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a1a65ccd-194d-4944-bfed-7aa67e1ebcf9 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a1a65ccd-194d-4944-bfed-7aa67e1ebcf9 tempest-VolumesSnapshotTestJSON-606072181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a1a65ccd-194d-4944-bfed-7aa67e1ebcf9 tempest-VolumesSnapshotTestJSON-606072181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a1a65ccd-194d-4944-bfed-7aa67e1ebcf9 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a1a65ccd-194d-4944-bfed-7aa67e1ebcf9 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:00 devstack sudo[103681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:21:00 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6455fa42-2ce0-430e-a531-9b77862f29e2 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "cinder-0da36aa9-5081-4c3a-ab7d-82a189c0d45c-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6455fa42-2ce0-430e-a531-9b77862f29e2 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-0da36aa9-5081-4c3a-ab7d-82a189c0d45c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6455fa42-2ce0-430e-a531-9b77862f29e2 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "cinder-quobyte-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6455fa42-2ce0-430e-a531-9b77862f29e2 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6455fa42-2ce0-430e-a531-9b77862f29e2 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "cinder-quobyte-0da36aa9-5081-4c3a-ab7d-82a189c0d45c" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6455fa42-2ce0-430e-a531-9b77862f29e2 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-0da36aa9-5081-4c3a-ab7d-82a189c0d45c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-6455fa42-2ce0-430e-a531-9b77862f29e2 tempest-VolumesSnapshotTestJSON-606072181 None] Deleting offline snapshot 0da36aa9-5081-4c3a-ab7d-82a189c0d45c of volume c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:21:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-6455fa42-2ce0-430e-a531-9b77862f29e2 tempest-VolumesSnapshotTestJSON-606072181 None] snapshot_file for this snap is: volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.0da36aa9-5081-4c3a-ab7d-82a189c0d45c {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:21:00 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc69cd4-207b-40db-80fd-b018c1694abd]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6455fa42-2ce0-430e-a531-9b77862f29e2 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.0da36aa9-5081-4c3a-ab7d-82a189c0d45c {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:00 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a1a65ccd-194d-4944-bfed-7aa67e1ebcf9 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.371s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:00 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-a1a65ccd-194d-4944-bfed-7aa67e1ebcf9 tempest-VolumesSnapshotTestJSON-606072181 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:00 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-a1a65ccd-194d-4944-bfed-7aa67e1ebcf9 tempest-VolumesSnapshotTestJSON-606072181 None] Deleted volume successfully. Sep 28 18:21:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a1a65ccd-194d-4944-bfed-7aa67e1ebcf9 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-55336c33-2980-44a5-b3ee-aca1a26ca894-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:00 devstack sudo[103686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.0da36aa9-5081-4c3a-ab7d-82a189c0d45c Sep 28 18:21:00 devstack sudo[103686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:01 devstack sudo[103686]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6455fa42-2ce0-430e-a531-9b77862f29e2 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.0da36aa9-5081-4c3a-ab7d-82a189c0d45c" returned: 0 in 0.586s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-6455fa42-2ce0-430e-a531-9b77862f29e2 tempest-VolumesSnapshotTestJSON-606072181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:21:01 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1771d851-2a3a-4ef4-ba6f-84b76f15df21]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6455fa42-2ce0-430e-a531-9b77862f29e2 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:01 devstack sudo[103701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7 Sep 28 18:21:01 devstack sudo[103701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:01 devstack sudo[103701]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6455fa42-2ce0-430e-a531-9b77862f29e2 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7" returned: 0 in 0.627s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6455fa42-2ce0-430e-a531-9b77862f29e2 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.0da36aa9-5081-4c3a-ab7d-82a189c0d45c {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:01 devstack sudo[103711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.0da36aa9-5081-4c3a-ab7d-82a189c0d45c Sep 28 18:21:01 devstack sudo[103711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:02 devstack sudo[103711]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6455fa42-2ce0-430e-a531-9b77862f29e2 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.0da36aa9-5081-4c3a-ab7d-82a189c0d45c" returned: 0 in 0.556s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6455fa42-2ce0-430e-a531-9b77862f29e2 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.0da36aa9-5081-4c3a-ab7d-82a189c0d45c {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:02 devstack sudo[103723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.0da36aa9-5081-4c3a-ab7d-82a189c0d45c Sep 28 18:21:02 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:02 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-6b3c6e5d-35b6-4b1f-9681-45472146cb02 req-0acd0893-1461-4013-b2bf-f3f486e046d0 tempest-TestStampPattern-57928506 None] Terminate volume connection completed successfully. Sep 28 18:21:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-6b3c6e5d-35b6-4b1f-9681-45472146cb02 req-0acd0893-1461-4013-b2bf-f3f486e046d0 tempest-TestStampPattern-57928506 None] Deleting attachment 3460f5e5-26d9-417d-b6ec-85669b9fff39. {{(pid=86980) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:21:02 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6455fa42-2ce0-430e-a531-9b77862f29e2 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7.0da36aa9-5081-4c3a-ab7d-82a189c0d45c" returned: 0 in 0.481s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:02 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6455fa42-2ce0-430e-a531-9b77862f29e2 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-0da36aa9-5081-4c3a-ab7d-82a189c0d45c" released by "_delete_snapshot" :: held 2.461s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:02 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6455fa42-2ce0-430e-a531-9b77862f29e2 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7" released by "delete_snapshot" :: held 2.524s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:03 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-6455fa42-2ce0-430e-a531-9b77862f29e2 tempest-VolumesSnapshotTestJSON-606072181 None] Created reservations ['5c6d60de-641e-4ede-884f-96a055239c99', '614f2312-f495-4457-b2c6-01b05a09ae51', '831706d8-887a-4ec6-b0d2-7067dc78a599', '36afe797-d0fb-436b-838f-3f8fb05be096'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:03 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-6455fa42-2ce0-430e-a531-9b77862f29e2 tempest-VolumesSnapshotTestJSON-606072181 None] Delete snapshot completed successfully. Sep 28 18:21:03 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6455fa42-2ce0-430e-a531-9b77862f29e2 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-0da36aa9-5081-4c3a-ab7d-82a189c0d45c-delete_snapshot" released by "delete_snapshot" :: held 2.788s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:03 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d7791249-0a57-4f3c-bc7c-2f60882daa51 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "cinder-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:03 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d7791249-0a57-4f3c-bc7c-2f60882daa51 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d7791249-0a57-4f3c-bc7c-2f60882daa51 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "cinder-quobyte-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d7791249-0a57-4f3c-bc7c-2f60882daa51 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7" acquired by "delete_volume" :: waited 0.023s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:04 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4dc1852-f1b7-4845-a52b-2ad6d2883108]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d7791249-0a57-4f3c-bc7c-2f60882daa51 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:04 devstack sudo[103761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7 Sep 28 18:21:04 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:21:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:04 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:21:04 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:04 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d7791249-0a57-4f3c-bc7c-2f60882daa51 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7" returned: 0 in 0.795s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d7791249-0a57-4f3c-bc7c-2f60882daa51 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:04 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7 Sep 28 18:21:04 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:05 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.599s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:05 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:05 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager._thread_info {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:21:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread count: 28 {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:21:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread info: [<_MainThread(MainThread, started 129097393381504)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:21:05 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d7791249-0a57-4f3c-bc7c-2f60882daa51 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7" returned: 0 in 0.595s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d7791249-0a57-4f3c-bc7c-2f60882daa51 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7" released by "delete_volume" :: held 1.525s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:05 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-d7791249-0a57-4f3c-bc7c-2f60882daa51 tempest-VolumesSnapshotTestJSON-606072181 None] Created reservations ['4e284cae-53d1-49ef-8f89-3c21446fa5ce', '382a8b99-b427-477d-b64f-bfe6e9d48186', '620b8053-a1f7-4204-8907-bfa8e768ec1c', '3f2ce19b-82db-453d-a8d4-bd73f35384e2'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d7791249-0a57-4f3c-bc7c-2f60882daa51 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d7791249-0a57-4f3c-bc7c-2f60882daa51 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d7791249-0a57-4f3c-bc7c-2f60882daa51 tempest-VolumesSnapshotTestJSON-606072181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d7791249-0a57-4f3c-bc7c-2f60882daa51 tempest-VolumesSnapshotTestJSON-606072181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d7791249-0a57-4f3c-bc7c-2f60882daa51 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d7791249-0a57-4f3c-bc7c-2f60882daa51 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:05 devstack sudo[103799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:21:05 devstack sudo[103799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:06 devstack sudo[103799]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d7791249-0a57-4f3c-bc7c-2f60882daa51 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.421s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:06 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-d7791249-0a57-4f3c-bc7c-2f60882daa51 tempest-VolumesSnapshotTestJSON-606072181 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:06 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-d7791249-0a57-4f3c-bc7c-2f60882daa51 tempest-VolumesSnapshotTestJSON-606072181 None] Deleted volume successfully. Sep 28 18:21:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d7791249-0a57-4f3c-bc7c-2f60882daa51 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-c9f5e2ab-8d7f-4e34-b31f-1fce99267cb7-delete_volume" released by "delete_volume" :: held 2.463s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-21779a61-bb4c-482d-8a56-4cb383915010 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "cinder-8e1ae389-5b43-45d7-ad79-be3095c225b8-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-21779a61-bb4c-482d-8a56-4cb383915010 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-8e1ae389-5b43-45d7-ad79-be3095c225b8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-21779a61-bb4c-482d-8a56-4cb383915010 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "cinder-quobyte-8e1ae389-5b43-45d7-ad79-be3095c225b8" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-21779a61-bb4c-482d-8a56-4cb383915010 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-8e1ae389-5b43-45d7-ad79-be3095c225b8" acquired by "delete_volume" :: waited 0.019s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:06 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a46684-cac2-4f11-b86d-5929b23b648c]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-21779a61-bb4c-482d-8a56-4cb383915010 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:06 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8 Sep 28 18:21:06 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:07 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-21779a61-bb4c-482d-8a56-4cb383915010 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8" returned: 0 in 0.550s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-21779a61-bb4c-482d-8a56-4cb383915010 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:07 devstack sudo[103811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8 Sep 28 18:21:07 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:07 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-21779a61-bb4c-482d-8a56-4cb383915010 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8e1ae389-5b43-45d7-ad79-be3095c225b8" returned: 0 in 0.350s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:07 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-21779a61-bb4c-482d-8a56-4cb383915010 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-quobyte-8e1ae389-5b43-45d7-ad79-be3095c225b8" released by "delete_volume" :: held 1.024s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:07 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-21779a61-bb4c-482d-8a56-4cb383915010 tempest-VolumesSnapshotTestJSON-606072181 None] Created reservations ['04745938-cc7b-4bd6-957e-b1eae820a45f', 'd01bc258-f559-49e0-9718-ee673d7ea291', 'cbce0e7d-65de-4b5f-b3d6-78b583e4acb9', '27e2d403-64f5-4c8e-833c-7d92e7ef85e3'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-21779a61-bb4c-482d-8a56-4cb383915010 tempest-VolumesSnapshotTestJSON-606072181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-21779a61-bb4c-482d-8a56-4cb383915010 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-21779a61-bb4c-482d-8a56-4cb383915010 tempest-VolumesSnapshotTestJSON-606072181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-21779a61-bb4c-482d-8a56-4cb383915010 tempest-VolumesSnapshotTestJSON-606072181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-21779a61-bb4c-482d-8a56-4cb383915010 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-21779a61-bb4c-482d-8a56-4cb383915010 tempest-VolumesSnapshotTestJSON-606072181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:07 devstack sudo[103814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:21:07 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:08 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-21779a61-bb4c-482d-8a56-4cb383915010 tempest-VolumesSnapshotTestJSON-606072181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.285s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:08 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-21779a61-bb4c-482d-8a56-4cb383915010 tempest-VolumesSnapshotTestJSON-606072181 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:08 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-21779a61-bb4c-482d-8a56-4cb383915010 tempest-VolumesSnapshotTestJSON-606072181 None] Deleted volume successfully. Sep 28 18:21:08 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bafe3779-b5d2-46d9-b0e6-5a39eeead34e tempest-TestStampPattern-57928506 None] Acquiring lock "cinder-bd67098d-c998-4dcd-85a4-35ef902f6d35-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:08 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-21779a61-bb4c-482d-8a56-4cb383915010 tempest-VolumesSnapshotTestJSON-606072181 None] Lock "cinder-8e1ae389-5b43-45d7-ad79-be3095c225b8-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:08 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bafe3779-b5d2-46d9-b0e6-5a39eeead34e tempest-TestStampPattern-57928506 None] Lock "cinder-bd67098d-c998-4dcd-85a4-35ef902f6d35-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:08 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bafe3779-b5d2-46d9-b0e6-5a39eeead34e tempest-TestStampPattern-57928506 None] Acquiring lock "cinder-quobyte-bd67098d-c998-4dcd-85a4-35ef902f6d35" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:08 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bafe3779-b5d2-46d9-b0e6-5a39eeead34e tempest-TestStampPattern-57928506 None] Lock "cinder-quobyte-bd67098d-c998-4dcd-85a4-35ef902f6d35" acquired by "delete_volume" :: waited 0.016s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:08 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[79147f3e-83b6-4c3f-b083-cacc549921ec]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bafe3779-b5d2-46d9-b0e6-5a39eeead34e tempest-TestStampPattern-57928506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bd67098d-c998-4dcd-85a4-35ef902f6d35 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:08 devstack sudo[103818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bd67098d-c998-4dcd-85a4-35ef902f6d35 Sep 28 18:21:08 devstack sudo[103818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:08 devstack sudo[103818]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bafe3779-b5d2-46d9-b0e6-5a39eeead34e tempest-TestStampPattern-57928506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bd67098d-c998-4dcd-85a4-35ef902f6d35" returned: 0 in 0.392s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bafe3779-b5d2-46d9-b0e6-5a39eeead34e tempest-TestStampPattern-57928506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bd67098d-c998-4dcd-85a4-35ef902f6d35 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:08 devstack sudo[103823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bd67098d-c998-4dcd-85a4-35ef902f6d35 Sep 28 18:21:08 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:09 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bafe3779-b5d2-46d9-b0e6-5a39eeead34e tempest-TestStampPattern-57928506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-bd67098d-c998-4dcd-85a4-35ef902f6d35" returned: 0 in 0.281s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:09 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bafe3779-b5d2-46d9-b0e6-5a39eeead34e tempest-TestStampPattern-57928506 None] Lock "cinder-quobyte-bd67098d-c998-4dcd-85a4-35ef902f6d35" released by "delete_volume" :: held 0.721s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:09 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-bafe3779-b5d2-46d9-b0e6-5a39eeead34e tempest-TestStampPattern-57928506 None] Created reservations ['3418b90e-6b0f-4727-b005-e3ef6950ecd8', 'cc3348c8-acd4-41d6-a4af-8bcb9ad1ec8c', '86743dbd-a998-4ce8-a3ee-c620e377758c', 'd83a93d5-8a82-4d46-9069-5f239c54e34c'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bafe3779-b5d2-46d9-b0e6-5a39eeead34e tempest-TestStampPattern-57928506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bafe3779-b5d2-46d9-b0e6-5a39eeead34e tempest-TestStampPattern-57928506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-bafe3779-b5d2-46d9-b0e6-5a39eeead34e tempest-TestStampPattern-57928506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-bafe3779-b5d2-46d9-b0e6-5a39eeead34e tempest-TestStampPattern-57928506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bafe3779-b5d2-46d9-b0e6-5a39eeead34e tempest-TestStampPattern-57928506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bafe3779-b5d2-46d9-b0e6-5a39eeead34e tempest-TestStampPattern-57928506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:09 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:21:09 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:09 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bafe3779-b5d2-46d9-b0e6-5a39eeead34e tempest-TestStampPattern-57928506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.337s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:09 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-bafe3779-b5d2-46d9-b0e6-5a39eeead34e tempest-TestStampPattern-57928506 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:09 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-bafe3779-b5d2-46d9-b0e6-5a39eeead34e tempest-TestStampPattern-57928506 None] Deleted volume successfully. Sep 28 18:21:09 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bafe3779-b5d2-46d9-b0e6-5a39eeead34e tempest-TestStampPattern-57928506 None] Lock "cinder-bd67098d-c998-4dcd-85a4-35ef902f6d35-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:09 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4b49ec33-7cca-44aa-8b00-e79605710f2d tempest-TestStampPattern-57928506 None] Acquiring lock "cinder-e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:09 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4b49ec33-7cca-44aa-8b00-e79605710f2d tempest-TestStampPattern-57928506 None] Lock "cinder-e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:09 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4b49ec33-7cca-44aa-8b00-e79605710f2d tempest-TestStampPattern-57928506 None] Acquiring lock "cinder-quobyte-dab0d3e8-312a-46bb-8a02-ae93840ed026" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:09 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4b49ec33-7cca-44aa-8b00-e79605710f2d tempest-TestStampPattern-57928506 None] Lock "cinder-quobyte-dab0d3e8-312a-46bb-8a02-ae93840ed026" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:09 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4b49ec33-7cca-44aa-8b00-e79605710f2d tempest-TestStampPattern-57928506 None] Acquiring lock "cinder-quobyte-e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:10 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4b49ec33-7cca-44aa-8b00-e79605710f2d tempest-TestStampPattern-57928506 None] Lock "cinder-quobyte-e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:10 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-4b49ec33-7cca-44aa-8b00-e79605710f2d tempest-TestStampPattern-57928506 None] Deleting offline snapshot e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3 of volume dab0d3e8-312a-46bb-8a02-ae93840ed026 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:21:10 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-4b49ec33-7cca-44aa-8b00-e79605710f2d tempest-TestStampPattern-57928506 None] snapshot_file for this snap is: volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:21:10 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[860767aa-59d1-4513-b824-296dd144d72e]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4b49ec33-7cca-44aa-8b00-e79605710f2d tempest-TestStampPattern-57928506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:10 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3 Sep 28 18:21:10 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:10 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4b49ec33-7cca-44aa-8b00-e79605710f2d tempest-TestStampPattern-57928506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3" returned: 0 in 0.443s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:10 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-4b49ec33-7cca-44aa-8b00-e79605710f2d tempest-TestStampPattern-57928506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dab0d3e8-312a-46bb-8a02-ae93840ed026(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:21:10 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8e06b3-8a4e-4616-aec8-a546c283a8e0]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4b49ec33-7cca-44aa-8b00-e79605710f2d tempest-TestStampPattern-57928506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:10 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026 Sep 28 18:21:10 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:11 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4b49ec33-7cca-44aa-8b00-e79605710f2d tempest-TestStampPattern-57928506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026" returned: 0 in 0.638s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4b49ec33-7cca-44aa-8b00-e79605710f2d tempest-TestStampPattern-57928506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:11 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3 Sep 28 18:21:11 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:11 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4b49ec33-7cca-44aa-8b00-e79605710f2d tempest-TestStampPattern-57928506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3" returned: 0 in 0.418s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4b49ec33-7cca-44aa-8b00-e79605710f2d tempest-TestStampPattern-57928506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:11 devstack sudo[103848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3 Sep 28 18:21:11 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:11 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4b49ec33-7cca-44aa-8b00-e79605710f2d tempest-TestStampPattern-57928506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026.e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3" returned: 0 in 0.303s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:11 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4b49ec33-7cca-44aa-8b00-e79605710f2d tempest-TestStampPattern-57928506 None] Lock "cinder-quobyte-e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3" released by "_delete_snapshot" :: held 1.972s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:12 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4b49ec33-7cca-44aa-8b00-e79605710f2d tempest-TestStampPattern-57928506 None] Lock "cinder-quobyte-dab0d3e8-312a-46bb-8a02-ae93840ed026" released by "delete_snapshot" :: held 2.002s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:12 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-4b49ec33-7cca-44aa-8b00-e79605710f2d tempest-TestStampPattern-57928506 None] Created reservations ['f6a5a4d9-5925-4625-bf2c-15782bbaab99', 'a55d17c6-f005-42f8-b1f8-cb714f4b248f', '6c5cd71d-b341-4cb7-8b34-753e4b38a1f5', 'a9406b53-f612-4e3d-8670-42ab15cdbd1b'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:12 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-4b49ec33-7cca-44aa-8b00-e79605710f2d tempest-TestStampPattern-57928506 None] Delete snapshot completed successfully. Sep 28 18:21:12 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4b49ec33-7cca-44aa-8b00-e79605710f2d tempest-TestStampPattern-57928506 None] Lock "cinder-e4c11aa3-55b6-4e56-b1e8-ebf4d8ef34f3-delete_snapshot" released by "delete_snapshot" :: held 2.208s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:17 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fcc28ec0-5e09-402a-9593-114813caa6bc tempest-TestStampPattern-57928506 None] Acquiring lock "cinder-dab0d3e8-312a-46bb-8a02-ae93840ed026-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:17 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fcc28ec0-5e09-402a-9593-114813caa6bc tempest-TestStampPattern-57928506 None] Lock "cinder-dab0d3e8-312a-46bb-8a02-ae93840ed026-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:17 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fcc28ec0-5e09-402a-9593-114813caa6bc tempest-TestStampPattern-57928506 None] Acquiring lock "cinder-quobyte-dab0d3e8-312a-46bb-8a02-ae93840ed026" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:17 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fcc28ec0-5e09-402a-9593-114813caa6bc tempest-TestStampPattern-57928506 None] Lock "cinder-quobyte-dab0d3e8-312a-46bb-8a02-ae93840ed026" acquired by "delete_volume" :: waited 0.016s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:17 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5d13a1-e5d9-4ee9-99ad-ab6ef83716bc]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fcc28ec0-5e09-402a-9593-114813caa6bc tempest-TestStampPattern-57928506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:17 devstack sudo[103882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026 Sep 28 18:21:17 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:18 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fcc28ec0-5e09-402a-9593-114813caa6bc tempest-TestStampPattern-57928506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026" returned: 0 in 0.555s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fcc28ec0-5e09-402a-9593-114813caa6bc tempest-TestStampPattern-57928506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:18 devstack sudo[103887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026 Sep 28 18:21:18 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:18 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fcc28ec0-5e09-402a-9593-114813caa6bc tempest-TestStampPattern-57928506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dab0d3e8-312a-46bb-8a02-ae93840ed026" returned: 0 in 0.264s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fcc28ec0-5e09-402a-9593-114813caa6bc tempest-TestStampPattern-57928506 None] Lock "cinder-quobyte-dab0d3e8-312a-46bb-8a02-ae93840ed026" released by "delete_volume" :: held 0.906s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:18 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-fcc28ec0-5e09-402a-9593-114813caa6bc tempest-TestStampPattern-57928506 None] Created reservations ['6e618a9b-659a-456e-b939-3bf664ef3f28', '128a4287-09e9-4dcb-8cff-51f65263173f', '522a75e2-9726-4e11-915c-d311b6d928d1', '05ac044d-756e-4129-b0b1-60b45bc7f134'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-fcc28ec0-5e09-402a-9593-114813caa6bc tempest-TestStampPattern-57928506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-fcc28ec0-5e09-402a-9593-114813caa6bc tempest-TestStampPattern-57928506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-fcc28ec0-5e09-402a-9593-114813caa6bc tempest-TestStampPattern-57928506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-fcc28ec0-5e09-402a-9593-114813caa6bc tempest-TestStampPattern-57928506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-fcc28ec0-5e09-402a-9593-114813caa6bc tempest-TestStampPattern-57928506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fcc28ec0-5e09-402a-9593-114813caa6bc tempest-TestStampPattern-57928506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:18 devstack sudo[103890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:21:18 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:19 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fcc28ec0-5e09-402a-9593-114813caa6bc tempest-TestStampPattern-57928506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.314s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:19 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-fcc28ec0-5e09-402a-9593-114813caa6bc tempest-TestStampPattern-57928506 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:19 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-fcc28ec0-5e09-402a-9593-114813caa6bc tempest-TestStampPattern-57928506 None] Deleted volume successfully. Sep 28 18:21:19 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-fcc28ec0-5e09-402a-9593-114813caa6bc tempest-TestStampPattern-57928506 None] Lock "cinder-dab0d3e8-312a-46bb-8a02-ae93840ed026-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:19 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:19 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Flow 'volume_create_manager' (494c343f-2e40-4bd2-a723-43c87da2b2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:19 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e762da-58d1-4222-a34f-adee3b494e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:19 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e762da-58d1-4222-a34f-adee3b494e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1869648854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a35b0144-7efd-4165-a71c-ed1d9e6d38f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c058b6234a1e41458073c72f00ffb4d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:20Z,use_quota=True,user_id='95df73933bf64b83b2cbaff36c8217a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:19 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a64e279-f299-4bcb-8cd9-14be0a9255fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:19 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a64e279-f299-4bcb-8cd9-14be0a9255fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:19 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4331a90-1d4c-4e7c-97c6-189ebbb0a311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:19 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4331a90-1d4c-4e7c-97c6-189ebbb0a311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a35b0144-7efd-4165-a71c-ed1d9e6d38f7', 'volume_name': 'volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:19 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba6b503-38ea-4426-b568-3149b73861e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:19 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba6b503-38ea-4426-b568-3149b73861e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:19 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1183bca7-cdab-48a4-ac96-76718ce75ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:19 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Volume a35b0144-7efd-4165-a71c-ed1d9e6d38f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7', 'volume_size': 1} Sep 28 18:21:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1869648854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a35b0144-7efd-4165-a71c-ed1d9e6d38f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c058b6234a1e41458073c72f00ffb4d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:20Z,use_quota=True,user_id='95df73933bf64b83b2cbaff36c8217a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Creating volume a35b0144-7efd-4165-a71c-ed1d9e6d38f7 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:19 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:21:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:19 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7 1073741824 Sep 28 18:21:19 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:20 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7 1073741824" returned: 0 in 0.517s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:20 devstack sudo[103899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7 Sep 28 18:21:20 devstack sudo[103899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:20 devstack sudo[103899]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7" returned: 0 in 0.311s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:20 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1183bca7-cdab-48a4-ac96-76718ce75ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c54076f-1d11-4f5a-8de2-bfde9b5bd1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:20 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Volume volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7 (a35b0144-7efd-4165-a71c-ed1d9e6d38f7): created successfully Sep 28 18:21:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c54076f-1d11-4f5a-8de2-bfde9b5bd1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:20 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Flow 'volume_create_manager' (494c343f-2e40-4bd2-a723-43c87da2b2ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:21 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-8eec09fe-13dd-4581-858e-6e99359958f3 tempest-VolumesSnapshotListTestJSON-1264774145 None] Created volume successfully. Sep 28 18:21:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3be7146d-63bf-4a4c-af25-be50e599650b tempest-VolumesSnapshotListTestJSON-1264774145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3be7146d-63bf-4a4c-af25-be50e599650b tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:22 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-3be7146d-63bf-4a4c-af25-be50e599650b tempest-VolumesSnapshotListTestJSON-1264774145 None] Creating offline snapshot 6d1b37a9-3558-463c-9300-b3755f438234 of volume a35b0144-7efd-4165-a71c-ed1d9e6d38f7 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:21:22 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1d7b82-6b0f-4464-93b2-79f3bce40404]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3be7146d-63bf-4a4c-af25-be50e599650b tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:22 devstack sudo[103904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7 Sep 28 18:21:22 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:22 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3be7146d-63bf-4a4c-af25-be50e599650b tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7" returned: 0 in 0.426s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3be7146d-63bf-4a4c-af25-be50e599650b tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:22 devstack sudo[103909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234 1G Sep 28 18:21:22 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:23 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3be7146d-63bf-4a4c-af25-be50e599650b tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234 1G" returned: 0 in 0.454s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3be7146d-63bf-4a4c-af25-be50e599650b tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:23 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234 Sep 28 18:21:23 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:23 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3be7146d-63bf-4a4c-af25-be50e599650b tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234" returned: 0 in 0.422s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:23 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-3be7146d-63bf-4a4c-af25-be50e599650b tempest-VolumesSnapshotListTestJSON-1264774145 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234 is being set with open permissions: ugo+rw Sep 28 18:21:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3be7146d-63bf-4a4c-af25-be50e599650b tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:23 devstack sudo[103919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234 Sep 28 18:21:23 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:23 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3be7146d-63bf-4a4c-af25-be50e599650b tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234" returned: 0 in 0.296s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3be7146d-63bf-4a4c-af25-be50e599650b tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:23 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.info Sep 28 18:21:23 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:24 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3be7146d-63bf-4a4c-af25-be50e599650b tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.info" returned: 0 in 0.331s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:24 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-3be7146d-63bf-4a4c-af25-be50e599650b tempest-VolumesSnapshotListTestJSON-1264774145 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.info is being set with open permissions: ugo+rw Sep 28 18:21:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3be7146d-63bf-4a4c-af25-be50e599650b tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:24 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.info Sep 28 18:21:24 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:24 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3be7146d-63bf-4a4c-af25-be50e599650b tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.info" returned: 0 in 0.331s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3be7146d-63bf-4a4c-af25-be50e599650b tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.383s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:24 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-3be7146d-63bf-4a4c-af25-be50e599650b tempest-VolumesSnapshotListTestJSON-1264774145 None] Create snapshot completed successfully Sep 28 18:21:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0ac9e8b6-68a2-4e76-a6bc-cc79fab126e1 tempest-VolumesSnapshotListTestJSON-1264774145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0ac9e8b6-68a2-4e76-a6bc-cc79fab126e1 tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:25 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-0ac9e8b6-68a2-4e76-a6bc-cc79fab126e1 tempest-VolumesSnapshotListTestJSON-1264774145 None] Creating offline snapshot f44c47d8-241f-4a80-9221-b5ad88edc9a1 of volume a35b0144-7efd-4165-a71c-ed1d9e6d38f7 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:21:25 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ef49f0-6963-4189-b530-31201b8576e7]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0ac9e8b6-68a2-4e76-a6bc-cc79fab126e1 tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:25 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234 Sep 28 18:21:25 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:26 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0ac9e8b6-68a2-4e76-a6bc-cc79fab126e1 tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234" returned: 0 in 0.564s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:26 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-0ac9e8b6-68a2-4e76-a6bc-cc79fab126e1 tempest-VolumesSnapshotListTestJSON-1264774145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:21:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0ac9e8b6-68a2-4e76-a6bc-cc79fab126e1 tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:26 devstack sudo[103935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1 1G Sep 28 18:21:26 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:26 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0ac9e8b6-68a2-4e76-a6bc-cc79fab126e1 tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1 1G" returned: 0 in 0.596s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0ac9e8b6-68a2-4e76-a6bc-cc79fab126e1 tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:26 devstack sudo[103941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1 Sep 28 18:21:26 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:27 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0ac9e8b6-68a2-4e76-a6bc-cc79fab126e1 tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1" returned: 0 in 0.429s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:27 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-0ac9e8b6-68a2-4e76-a6bc-cc79fab126e1 tempest-VolumesSnapshotListTestJSON-1264774145 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1 is being set with open permissions: ugo+rw Sep 28 18:21:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0ac9e8b6-68a2-4e76-a6bc-cc79fab126e1 tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:27 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1 Sep 28 18:21:27 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:27 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0ac9e8b6-68a2-4e76-a6bc-cc79fab126e1 tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1" returned: 0 in 0.365s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0ac9e8b6-68a2-4e76-a6bc-cc79fab126e1 tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.102s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:27 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-0ac9e8b6-68a2-4e76-a6bc-cc79fab126e1 tempest-VolumesSnapshotListTestJSON-1264774145 None] Create snapshot completed successfully Sep 28 18:21:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-44325b9c-3dd7-4880-b991-d0ad04d6231e tempest-VolumesSnapshotListTestJSON-1264774145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-44325b9c-3dd7-4880-b991-d0ad04d6231e tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:28 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-44325b9c-3dd7-4880-b991-d0ad04d6231e tempest-VolumesSnapshotListTestJSON-1264774145 None] Creating offline snapshot 429afddb-a534-4520-924a-a1f1792a6090 of volume a35b0144-7efd-4165-a71c-ed1d9e6d38f7 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:21:28 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93a6402-454b-4e6d-a4d6-b72cc5939eb5]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-44325b9c-3dd7-4880-b991-d0ad04d6231e tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:29 devstack sudo[103950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1 Sep 28 18:21:29 devstack sudo[103950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:29 devstack sudo[103950]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-44325b9c-3dd7-4880-b991-d0ad04d6231e tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1" returned: 0 in 0.471s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-44325b9c-3dd7-4880-b991-d0ad04d6231e tempest-VolumesSnapshotListTestJSON-1264774145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:21:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-44325b9c-3dd7-4880-b991-d0ad04d6231e tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.429afddb-a534-4520-924a-a1f1792a6090 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:29 devstack sudo[103955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.429afddb-a534-4520-924a-a1f1792a6090 1G Sep 28 18:21:29 devstack sudo[103955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:30 devstack sudo[103955]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-44325b9c-3dd7-4880-b991-d0ad04d6231e tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.429afddb-a534-4520-924a-a1f1792a6090 1G" returned: 0 in 0.792s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-44325b9c-3dd7-4880-b991-d0ad04d6231e tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.429afddb-a534-4520-924a-a1f1792a6090 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:30 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.429afddb-a534-4520-924a-a1f1792a6090 Sep 28 18:21:30 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:30 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-44325b9c-3dd7-4880-b991-d0ad04d6231e tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.429afddb-a534-4520-924a-a1f1792a6090" returned: 0 in 0.389s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:30 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-44325b9c-3dd7-4880-b991-d0ad04d6231e tempest-VolumesSnapshotListTestJSON-1264774145 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.429afddb-a534-4520-924a-a1f1792a6090 is being set with open permissions: ugo+rw Sep 28 18:21:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-44325b9c-3dd7-4880-b991-d0ad04d6231e tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.429afddb-a534-4520-924a-a1f1792a6090 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:30 devstack sudo[103969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.429afddb-a534-4520-924a-a1f1792a6090 Sep 28 18:21:30 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:30 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-44325b9c-3dd7-4880-b991-d0ad04d6231e tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.429afddb-a534-4520-924a-a1f1792a6090" returned: 0 in 0.353s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-44325b9c-3dd7-4880-b991-d0ad04d6231e tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.139s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:31 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-44325b9c-3dd7-4880-b991-d0ad04d6231e tempest-VolumesSnapshotListTestJSON-1264774145 None] Create snapshot completed successfully Sep 28 18:21:33 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a77e3c24-f238-49d6-95ec-78ff6337a1bf tempest-VolumesSnapshotListTestJSON-1264774145 None] Acquiring lock "cinder-429afddb-a534-4520-924a-a1f1792a6090-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:33 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a77e3c24-f238-49d6-95ec-78ff6337a1bf tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "cinder-429afddb-a534-4520-924a-a1f1792a6090-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:33 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a77e3c24-f238-49d6-95ec-78ff6337a1bf tempest-VolumesSnapshotListTestJSON-1264774145 None] Acquiring lock "cinder-quobyte-a35b0144-7efd-4165-a71c-ed1d9e6d38f7" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:33 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a77e3c24-f238-49d6-95ec-78ff6337a1bf tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "cinder-quobyte-a35b0144-7efd-4165-a71c-ed1d9e6d38f7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:33 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a77e3c24-f238-49d6-95ec-78ff6337a1bf tempest-VolumesSnapshotListTestJSON-1264774145 None] Acquiring lock "cinder-quobyte-429afddb-a534-4520-924a-a1f1792a6090" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:33 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a77e3c24-f238-49d6-95ec-78ff6337a1bf tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "cinder-quobyte-429afddb-a534-4520-924a-a1f1792a6090" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-a77e3c24-f238-49d6-95ec-78ff6337a1bf tempest-VolumesSnapshotListTestJSON-1264774145 None] Deleting offline snapshot 429afddb-a534-4520-924a-a1f1792a6090 of volume a35b0144-7efd-4165-a71c-ed1d9e6d38f7 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:21:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-a77e3c24-f238-49d6-95ec-78ff6337a1bf tempest-VolumesSnapshotListTestJSON-1264774145 None] snapshot_file for this snap is: volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.429afddb-a534-4520-924a-a1f1792a6090 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:21:33 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3a8ef3-f34e-464e-aecd-a9ec03ab294a]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a77e3c24-f238-49d6-95ec-78ff6337a1bf tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.429afddb-a534-4520-924a-a1f1792a6090 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:33 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.429afddb-a534-4520-924a-a1f1792a6090 Sep 28 18:21:33 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:34 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a77e3c24-f238-49d6-95ec-78ff6337a1bf tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.429afddb-a534-4520-924a-a1f1792a6090" returned: 0 in 0.514s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:34 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-a77e3c24-f238-49d6-95ec-78ff6337a1bf tempest-VolumesSnapshotListTestJSON-1264774145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:21:34 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c243660f-8a67-47d8-9139-572d247a14c0]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a77e3c24-f238-49d6-95ec-78ff6337a1bf tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:34 devstack sudo[103980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1 Sep 28 18:21:34 devstack sudo[103980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:34 devstack sudo[103980]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a77e3c24-f238-49d6-95ec-78ff6337a1bf tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1" returned: 0 in 0.448s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:34 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-a77e3c24-f238-49d6-95ec-78ff6337a1bf tempest-VolumesSnapshotListTestJSON-1264774145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:21:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a77e3c24-f238-49d6-95ec-78ff6337a1bf tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.429afddb-a534-4520-924a-a1f1792a6090 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:34 devstack sudo[103985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.429afddb-a534-4520-924a-a1f1792a6090 Sep 28 18:21:34 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:35 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a77e3c24-f238-49d6-95ec-78ff6337a1bf tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.429afddb-a534-4520-924a-a1f1792a6090" returned: 0 in 0.590s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a77e3c24-f238-49d6-95ec-78ff6337a1bf tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.429afddb-a534-4520-924a-a1f1792a6090 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:35 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.429afddb-a534-4520-924a-a1f1792a6090 Sep 28 18:21:35 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Flow 'volume_create_manager' (bbe5beeb-5642-4530-a4ff-2eb13caa758f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d76c573-5aea-4e13-b2c4-707fb1ccacfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d76c573-5aea-4e13-b2c4-707fb1ccacfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-653955627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fdacca2-6fce-4374-a205-6b645a04b7a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3814dd37ca3b4ffd9d09428bea96b48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:35Z,use_quota=True,user_id='9747c03df01c4f6fb28131a750d285e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791f8f9b-f9e5-4e2c-a61e-9a1ee9cda746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791f8f9b-f9e5-4e2c-a61e-9a1ee9cda746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b78aca0-f5c2-44ca-ba14-7ef1c105ed5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b78aca0-f5c2-44ca-ba14-7ef1c105ed5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fdacca2-6fce-4374-a205-6b645a04b7a6', 'volume_name': 'volume-4fdacca2-6fce-4374-a205-6b645a04b7a6', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78aa2a3d-7ebe-4f0b-adf4-39ba56276a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78aa2a3d-7ebe-4f0b-adf4-39ba56276a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b4ffac-d237-401d-8858-23f52bd7ab6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:35 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Volume 4fdacca2-6fce-4374-a205-6b645a04b7a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fdacca2-6fce-4374-a205-6b645a04b7a6', 'volume_size': 1} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-653955627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fdacca2-6fce-4374-a205-6b645a04b7a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3814dd37ca3b4ffd9d09428bea96b48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:35Z,use_quota=True,user_id='9747c03df01c4f6fb28131a750d285e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Creating volume 4fdacca2-6fce-4374-a205-6b645a04b7a6 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:35 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4fdacca2-6fce-4374-a205-6b645a04b7a6 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:35 devstack sudo[103992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4fdacca2-6fce-4374-a205-6b645a04b7a6 1073741824 Sep 28 18:21:35 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:35 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a77e3c24-f238-49d6-95ec-78ff6337a1bf tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.429afddb-a534-4520-924a-a1f1792a6090" returned: 0 in 0.363s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a77e3c24-f238-49d6-95ec-78ff6337a1bf tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "cinder-quobyte-429afddb-a534-4520-924a-a1f1792a6090" released by "_delete_snapshot" :: held 2.077s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a77e3c24-f238-49d6-95ec-78ff6337a1bf tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "cinder-quobyte-a35b0144-7efd-4165-a71c-ed1d9e6d38f7" released by "delete_snapshot" :: held 2.107s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Flow 'volume_create_manager' (8495e856-cbba-4a90-864b-62589b1639f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d101fff-102d-479c-b1de-44e9dbacbcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d101fff-102d-479c-b1de-44e9dbacbcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-668459315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b595efb-39f3-49c6-83aa-5e07606c6f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3814dd37ca3b4ffd9d09428bea96b48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:36Z,use_quota=True,user_id='9747c03df01c4f6fb28131a750d285e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d4b0633-1a8f-461b-9eeb-fb7536307236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d4b0633-1a8f-461b-9eeb-fb7536307236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e572fb09-efb6-49ba-8486-353f035d2d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e572fb09-efb6-49ba-8486-353f035d2d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b595efb-39f3-49c6-83aa-5e07606c6f69', 'volume_name': 'volume-4b595efb-39f3-49c6-83aa-5e07606c6f69', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d09810-a036-4330-bd4a-d3a1b7888c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d09810-a036-4330-bd4a-d3a1b7888c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b49f3f28-901e-4624-a3ee-3cb9177c227a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:35 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Volume 4b595efb-39f3-49c6-83aa-5e07606c6f69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b595efb-39f3-49c6-83aa-5e07606c6f69', 'volume_size': 1} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:35 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-a77e3c24-f238-49d6-95ec-78ff6337a1bf tempest-VolumesSnapshotListTestJSON-1264774145 None] Created reservations ['744ea37a-f0a6-4642-bcb5-122e98aaa639', '38554eb1-2596-4331-b08a-16bc87c65878', '0127df56-e003-453c-8aa8-f6f512976380', '9d1b7984-096c-4ee8-88a0-c604a6c8f8d3'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:36 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-a77e3c24-f238-49d6-95ec-78ff6337a1bf tempest-VolumesSnapshotListTestJSON-1264774145 None] Delete snapshot completed successfully. Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a77e3c24-f238-49d6-95ec-78ff6337a1bf tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "cinder-429afddb-a534-4520-924a-a1f1792a6090-delete_snapshot" released by "delete_snapshot" :: held 2.507s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:36 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4fdacca2-6fce-4374-a205-6b645a04b7a6 1073741824" returned: 0 in 0.684s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4fdacca2-6fce-4374-a205-6b645a04b7a6 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:36 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4fdacca2-6fce-4374-a205-6b645a04b7a6 Sep 28 18:21:36 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Flow 'volume_create_manager' (b64361a4-9760-48eb-a515-a42bbdff54bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167e5fdb-0c0d-4b25-ba4a-948657343d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167e5fdb-0c0d-4b25-ba4a-948657343d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-493190496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60be9869-359b-4ef1-9b38-f9915bebcd63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3814dd37ca3b4ffd9d09428bea96b48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:36Z,use_quota=True,user_id='9747c03df01c4f6fb28131a750d285e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8d22443-3f47-4181-8ea0-fda074eccca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8d22443-3f47-4181-8ea0-fda074eccca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62528012-0490-4790-a652-f1606a7cf24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62528012-0490-4790-a652-f1606a7cf24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60be9869-359b-4ef1-9b38-f9915bebcd63', 'volume_name': 'volume-60be9869-359b-4ef1-9b38-f9915bebcd63', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e529a38-5fe3-4fab-b430-c8856586885c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e529a38-5fe3-4fab-b430-c8856586885c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07fbcd5-5094-406f-be7f-57feea08b96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:36 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Volume 60be9869-359b-4ef1-9b38-f9915bebcd63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60be9869-359b-4ef1-9b38-f9915bebcd63', 'volume_size': 1} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:36 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4fdacca2-6fce-4374-a205-6b645a04b7a6" returned: 0 in 0.309s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.560s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-668459315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b595efb-39f3-49c6-83aa-5e07606c6f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3814dd37ca3b4ffd9d09428bea96b48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:36Z,use_quota=True,user_id='9747c03df01c4f6fb28131a750d285e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Creating volume 4b595efb-39f3-49c6-83aa-5e07606c6f69 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:36 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b595efb-39f3-49c6-83aa-5e07606c6f69 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b4ffac-d237-401d-8858-23f52bd7ab6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fdacca2-6fce-4374-a205-6b645a04b7a6', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c6b9b1b-3d1c-481b-acfb-4bbc44274443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:36 devstack sudo[104002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b595efb-39f3-49c6-83aa-5e07606c6f69 1073741824 Sep 28 18:21:36 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:36 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Volume volume-4fdacca2-6fce-4374-a205-6b645a04b7a6 (4fdacca2-6fce-4374-a205-6b645a04b7a6): created successfully Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c6b9b1b-3d1c-481b-acfb-4bbc44274443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Flow 'volume_create_manager' (bbe5beeb-5642-4530-a4ff-2eb13caa758f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:36 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-340f196a-1131-4968-ad61-68046a2de827 tempest-CreateVolumesFromImageTest-717962176 None] Created volume successfully. Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Flow 'volume_create_manager' (bebd5a18-8616-499e-959a-9c7da73c6df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade59053-5857-4326-88b5-a1ca258a0137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade59053-5857-4326-88b5-a1ca258a0137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1902574889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1b4d5a9-0100-4464-9cf1-60732f86210a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3814dd37ca3b4ffd9d09428bea96b48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:37Z,use_quota=True,user_id='9747c03df01c4f6fb28131a750d285e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (245d6b86-8798-4546-8480-6bc8582fa960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (245d6b86-8798-4546-8480-6bc8582fa960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7f4b61-1ebe-4e68-9299-fd85e5159e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7f4b61-1ebe-4e68-9299-fd85e5159e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1b4d5a9-0100-4464-9cf1-60732f86210a', 'volume_name': 'volume-f1b4d5a9-0100-4464-9cf1-60732f86210a', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c96cb55-882d-4d1a-a8ad-a6cc95f0f990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c96cb55-882d-4d1a-a8ad-a6cc95f0f990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0558a726-2671-42fe-a09a-8506ff4dbb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:36 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Volume f1b4d5a9-0100-4464-9cf1-60732f86210a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1b4d5a9-0100-4464-9cf1-60732f86210a', 'volume_size': 1} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d242c690-a6ef-411c-83cf-892b9a95e56c tempest-VolumesSnapshotListTestJSON-1264774145 None] Acquiring lock "cinder-f44c47d8-241f-4a80-9221-b5ad88edc9a1-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d242c690-a6ef-411c-83cf-892b9a95e56c tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "cinder-f44c47d8-241f-4a80-9221-b5ad88edc9a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d242c690-a6ef-411c-83cf-892b9a95e56c tempest-VolumesSnapshotListTestJSON-1264774145 None] Acquiring lock "cinder-quobyte-a35b0144-7efd-4165-a71c-ed1d9e6d38f7" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d242c690-a6ef-411c-83cf-892b9a95e56c tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "cinder-quobyte-a35b0144-7efd-4165-a71c-ed1d9e6d38f7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d242c690-a6ef-411c-83cf-892b9a95e56c tempest-VolumesSnapshotListTestJSON-1264774145 None] Acquiring lock "cinder-quobyte-f44c47d8-241f-4a80-9221-b5ad88edc9a1" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d242c690-a6ef-411c-83cf-892b9a95e56c tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "cinder-quobyte-f44c47d8-241f-4a80-9221-b5ad88edc9a1" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-d242c690-a6ef-411c-83cf-892b9a95e56c tempest-VolumesSnapshotListTestJSON-1264774145 None] Deleting offline snapshot f44c47d8-241f-4a80-9221-b5ad88edc9a1 of volume a35b0144-7efd-4165-a71c-ed1d9e6d38f7 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-d242c690-a6ef-411c-83cf-892b9a95e56c tempest-VolumesSnapshotListTestJSON-1264774145 None] snapshot_file for this snap is: volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a11698e-c5d7-4d58-b920-9a9a01f9bb2a]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d242c690-a6ef-411c-83cf-892b9a95e56c tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:37 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1 Sep 28 18:21:37 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:37 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b595efb-39f3-49c6-83aa-5e07606c6f69 1073741824" returned: 0 in 0.717s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Flow 'volume_create_manager' (7ec9019d-fdf9-4ab1-99e1-d8c6252be54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffbb3f75-c690-48b2-abb7-62831bc83741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffbb3f75-c690-48b2-abb7-62831bc83741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-344147729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=007bc5f9-2063-4955-8e7a-c332e1b3dbf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3814dd37ca3b4ffd9d09428bea96b48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:37Z,use_quota=True,user_id='9747c03df01c4f6fb28131a750d285e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c81c5eba-44fd-478c-bb92-a9f7de8b0cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c81c5eba-44fd-478c-bb92-a9f7de8b0cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b6b679c-f4f6-4216-8c2b-7ada4a05231d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b6b679c-f4f6-4216-8c2b-7ada4a05231d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '007bc5f9-2063-4955-8e7a-c332e1b3dbf4', 'volume_name': 'volume-007bc5f9-2063-4955-8e7a-c332e1b3dbf4', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d825023f-f28f-4421-82b5-3608ecbc3006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d825023f-f28f-4421-82b5-3608ecbc3006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (969b9169-c803-4489-b1f3-aaa8c1471069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:37 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Volume 007bc5f9-2063-4955-8e7a-c332e1b3dbf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-007bc5f9-2063-4955-8e7a-c332e1b3dbf4', 'volume_size': 1} Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b595efb-39f3-49c6-83aa-5e07606c6f69 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:37 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b595efb-39f3-49c6-83aa-5e07606c6f69 Sep 28 18:21:37 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:37 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d242c690-a6ef-411c-83cf-892b9a95e56c tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1" returned: 0 in 0.495s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-d242c690-a6ef-411c-83cf-892b9a95e56c tempest-VolumesSnapshotListTestJSON-1264774145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde3500a-974e-47be-9ddd-010204e7ea85]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d242c690-a6ef-411c-83cf-892b9a95e56c tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:37 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b595efb-39f3-49c6-83aa-5e07606c6f69" returned: 0 in 0.290s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.266s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-493190496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60be9869-359b-4ef1-9b38-f9915bebcd63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3814dd37ca3b4ffd9d09428bea96b48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:36Z,use_quota=True,user_id='9747c03df01c4f6fb28131a750d285e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Creating volume 60be9869-359b-4ef1-9b38-f9915bebcd63 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:37 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-60be9869-359b-4ef1-9b38-f9915bebcd63 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:37 devstack sudo[104015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234 Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b49f3f28-901e-4624-a3ee-3cb9177c227a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b595efb-39f3-49c6-83aa-5e07606c6f69', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:37 devstack sudo[104015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:37 devstack sudo[104017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-60be9869-359b-4ef1-9b38-f9915bebcd63 1073741824 Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b7d647-83e6-4538-92b8-1c0aa21b6622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:37 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:37 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Volume volume-4b595efb-39f3-49c6-83aa-5e07606c6f69 (4b595efb-39f3-49c6-83aa-5e07606c6f69): created successfully Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b7d647-83e6-4538-92b8-1c0aa21b6622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Flow 'volume_create_manager' (8495e856-cbba-4a90-864b-62589b1639f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:37 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-05e0c3d9-6cca-4d2b-a55d-91c022e11461 tempest-CreateVolumesFromImageTest-717962176 None] Created volume successfully. Sep 28 18:21:38 devstack sudo[104015]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d242c690-a6ef-411c-83cf-892b9a95e56c tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234" returned: 0 in 0.503s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-d242c690-a6ef-411c-83cf-892b9a95e56c tempest-VolumesSnapshotListTestJSON-1264774145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:21:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d242c690-a6ef-411c-83cf-892b9a95e56c tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:38 devstack sudo[104026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1 Sep 28 18:21:38 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:38 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-60be9869-359b-4ef1-9b38-f9915bebcd63 1073741824" returned: 0 in 0.523s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-60be9869-359b-4ef1-9b38-f9915bebcd63 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:38 devstack sudo[104029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-60be9869-359b-4ef1-9b38-f9915bebcd63 Sep 28 18:21:38 devstack sudo[104029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:38 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d242c690-a6ef-411c-83cf-892b9a95e56c tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1" returned: 0 in 0.441s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d242c690-a6ef-411c-83cf-892b9a95e56c tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:38 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1 Sep 28 18:21:38 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:38 devstack sudo[104029]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-60be9869-359b-4ef1-9b38-f9915bebcd63" returned: 0 in 0.331s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.684s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1902574889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1b4d5a9-0100-4464-9cf1-60732f86210a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3814dd37ca3b4ffd9d09428bea96b48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:37Z,use_quota=True,user_id='9747c03df01c4f6fb28131a750d285e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Creating volume f1b4d5a9-0100-4464-9cf1-60732f86210a {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:38 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:21:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f1b4d5a9-0100-4464-9cf1-60732f86210a 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:38 devstack sudo[104037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f1b4d5a9-0100-4464-9cf1-60732f86210a 1073741824 Sep 28 18:21:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07fbcd5-5094-406f-be7f-57feea08b96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60be9869-359b-4ef1-9b38-f9915bebcd63', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:38 devstack sudo[104037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0512127f-be62-42c1-a987-8afc419871cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:38 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Volume volume-60be9869-359b-4ef1-9b38-f9915bebcd63 (60be9869-359b-4ef1-9b38-f9915bebcd63): created successfully Sep 28 18:21:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0512127f-be62-42c1-a987-8afc419871cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Flow 'volume_create_manager' (b64361a4-9760-48eb-a515-a42bbdff54bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:38 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-27bd91cd-fb93-4843-af6c-ee8657794e4d tempest-CreateVolumesFromImageTest-717962176 None] Created volume successfully. Sep 28 18:21:38 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d242c690-a6ef-411c-83cf-892b9a95e56c tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.f44c47d8-241f-4a80-9221-b5ad88edc9a1" returned: 0 in 0.261s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:38 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d242c690-a6ef-411c-83cf-892b9a95e56c tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "cinder-quobyte-f44c47d8-241f-4a80-9221-b5ad88edc9a1" released by "_delete_snapshot" :: held 1.832s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:38 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d242c690-a6ef-411c-83cf-892b9a95e56c tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "cinder-quobyte-a35b0144-7efd-4165-a71c-ed1d9e6d38f7" released by "delete_snapshot" :: held 1.864s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:38 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-d242c690-a6ef-411c-83cf-892b9a95e56c tempest-VolumesSnapshotListTestJSON-1264774145 None] Created reservations ['bfac2786-8b13-4060-a20d-9b45b87d2282', '472dd48f-e342-4446-af00-b1429ee22194', '37e03b1f-b0db-48ec-8137-1ba4f3ea4200', 'ad6025bf-7033-4048-981c-29707698504c'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:38 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-d242c690-a6ef-411c-83cf-892b9a95e56c tempest-VolumesSnapshotListTestJSON-1264774145 None] Delete snapshot completed successfully. Sep 28 18:21:38 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d242c690-a6ef-411c-83cf-892b9a95e56c tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "cinder-f44c47d8-241f-4a80-9221-b5ad88edc9a1-delete_snapshot" released by "delete_snapshot" :: held 2.018s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-71b2d209-8d14-4938-9f1f-f7510e3113ac tempest-VolumesSnapshotListTestJSON-1264774145 None] Acquiring lock "cinder-6d1b37a9-3558-463c-9300-b3755f438234-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:39 devstack sudo[104037]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f1b4d5a9-0100-4464-9cf1-60732f86210a 1073741824" returned: 0 in 0.542s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-71b2d209-8d14-4938-9f1f-f7510e3113ac tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "cinder-6d1b37a9-3558-463c-9300-b3755f438234-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-71b2d209-8d14-4938-9f1f-f7510e3113ac tempest-VolumesSnapshotListTestJSON-1264774145 None] Acquiring lock "cinder-quobyte-a35b0144-7efd-4165-a71c-ed1d9e6d38f7" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-71b2d209-8d14-4938-9f1f-f7510e3113ac tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "cinder-quobyte-a35b0144-7efd-4165-a71c-ed1d9e6d38f7" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-71b2d209-8d14-4938-9f1f-f7510e3113ac tempest-VolumesSnapshotListTestJSON-1264774145 None] Acquiring lock "cinder-quobyte-6d1b37a9-3558-463c-9300-b3755f438234" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-71b2d209-8d14-4938-9f1f-f7510e3113ac tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "cinder-quobyte-6d1b37a9-3558-463c-9300-b3755f438234" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-71b2d209-8d14-4938-9f1f-f7510e3113ac tempest-VolumesSnapshotListTestJSON-1264774145 None] Deleting offline snapshot 6d1b37a9-3558-463c-9300-b3755f438234 of volume a35b0144-7efd-4165-a71c-ed1d9e6d38f7 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-71b2d209-8d14-4938-9f1f-f7510e3113ac tempest-VolumesSnapshotListTestJSON-1264774145 None] snapshot_file for this snap is: volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f1b4d5a9-0100-4464-9cf1-60732f86210a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[be639bd6-5900-472f-93b4-42d7feeaafd3]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-71b2d209-8d14-4938-9f1f-f7510e3113ac tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:39 devstack sudo[104044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f1b4d5a9-0100-4464-9cf1-60732f86210a Sep 28 18:21:39 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:39 devstack sudo[104045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234 Sep 28 18:21:39 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:39 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f1b4d5a9-0100-4464-9cf1-60732f86210a" returned: 0 in 0.306s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.169s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-344147729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=007bc5f9-2063-4955-8e7a-c332e1b3dbf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3814dd37ca3b4ffd9d09428bea96b48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:37Z,use_quota=True,user_id='9747c03df01c4f6fb28131a750d285e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Creating volume 007bc5f9-2063-4955-8e7a-c332e1b3dbf4 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:39 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-007bc5f9-2063-4955-8e7a-c332e1b3dbf4 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0558a726-2671-42fe-a09a-8506ff4dbb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1b4d5a9-0100-4464-9cf1-60732f86210a', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:39 devstack sudo[104049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-007bc5f9-2063-4955-8e7a-c332e1b3dbf4 1073741824 Sep 28 18:21:39 devstack sudo[104049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c2d135b-ba17-424b-9843-079906149316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:39 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Volume volume-f1b4d5a9-0100-4464-9cf1-60732f86210a (f1b4d5a9-0100-4464-9cf1-60732f86210a): created successfully Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c2d135b-ba17-424b-9843-079906149316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Flow 'volume_create_manager' (bebd5a18-8616-499e-959a-9c7da73c6df7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:39 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-944a2849-9c3a-4a95-bed2-6ef276776672 tempest-CreateVolumesFromImageTest-717962176 None] Created volume successfully. Sep 28 18:21:39 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-71b2d209-8d14-4938-9f1f-f7510e3113ac tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234" returned: 0 in 0.434s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-71b2d209-8d14-4938-9f1f-f7510e3113ac tempest-VolumesSnapshotListTestJSON-1264774145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5c6374-4173-4258-ae3c-9546ae511a19]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-71b2d209-8d14-4938-9f1f-f7510e3113ac tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:39 devstack sudo[104054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7 Sep 28 18:21:39 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:40 devstack sudo[104049]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-007bc5f9-2063-4955-8e7a-c332e1b3dbf4 1073741824" returned: 0 in 0.527s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-007bc5f9-2063-4955-8e7a-c332e1b3dbf4 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:40 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-007bc5f9-2063-4955-8e7a-c332e1b3dbf4 Sep 28 18:21:40 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:40 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-71b2d209-8d14-4938-9f1f-f7510e3113ac tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7" returned: 0 in 0.481s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-71b2d209-8d14-4938-9f1f-f7510e3113ac tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:40 devstack sudo[104065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234 Sep 28 18:21:40 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:40 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-007bc5f9-2063-4955-8e7a-c332e1b3dbf4" returned: 0 in 0.292s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:40 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:40 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (969b9169-c803-4489-b1f3-aaa8c1471069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-007bc5f9-2063-4955-8e7a-c332e1b3dbf4', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:40 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee27a2d-bb8b-4aba-beeb-5d32bfa5677a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:40 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Volume volume-007bc5f9-2063-4955-8e7a-c332e1b3dbf4 (007bc5f9-2063-4955-8e7a-c332e1b3dbf4): created successfully Sep 28 18:21:40 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee27a2d-bb8b-4aba-beeb-5d32bfa5677a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:40 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Flow 'volume_create_manager' (7ec9019d-fdf9-4ab1-99e1-d8c6252be54a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:40 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-8d5224a9-7de0-41c7-9d4e-afca1ac5b57b tempest-CreateVolumesFromImageTest-717962176 None] Created volume successfully. Sep 28 18:21:40 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-71b2d209-8d14-4938-9f1f-f7510e3113ac tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234" returned: 0 in 0.381s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-71b2d209-8d14-4938-9f1f-f7510e3113ac tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:40 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234 Sep 28 18:21:40 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-10ef768c-05a9-493a-8ef4-95616fc1fd24 tempest-CreateVolumesFromImageTest-717962176 None] Acquiring lock "cinder-007bc5f9-2063-4955-8e7a-c332e1b3dbf4-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-10ef768c-05a9-493a-8ef4-95616fc1fd24 tempest-CreateVolumesFromImageTest-717962176 None] Lock "cinder-007bc5f9-2063-4955-8e7a-c332e1b3dbf4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-10ef768c-05a9-493a-8ef4-95616fc1fd24 tempest-CreateVolumesFromImageTest-717962176 None] Acquiring lock "cinder-quobyte-007bc5f9-2063-4955-8e7a-c332e1b3dbf4" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-10ef768c-05a9-493a-8ef4-95616fc1fd24 tempest-CreateVolumesFromImageTest-717962176 None] Lock "cinder-quobyte-007bc5f9-2063-4955-8e7a-c332e1b3dbf4" acquired by "delete_volume" :: waited 0.022s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:40 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f53150-5e51-4ba3-bc28-3e2c93429eaf]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-10ef768c-05a9-493a-8ef4-95616fc1fd24 tempest-CreateVolumesFromImageTest-717962176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-007bc5f9-2063-4955-8e7a-c332e1b3dbf4 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:40 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-71b2d209-8d14-4938-9f1f-f7510e3113ac tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7.6d1b37a9-3558-463c-9300-b3755f438234" returned: 0 in 0.318s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-71b2d209-8d14-4938-9f1f-f7510e3113ac tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "cinder-quobyte-6d1b37a9-3558-463c-9300-b3755f438234" released by "_delete_snapshot" :: held 1.768s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-71b2d209-8d14-4938-9f1f-f7510e3113ac tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "cinder-quobyte-a35b0144-7efd-4165-a71c-ed1d9e6d38f7" released by "delete_snapshot" :: held 1.797s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:40 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-007bc5f9-2063-4955-8e7a-c332e1b3dbf4 Sep 28 18:21:40 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:40 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-71b2d209-8d14-4938-9f1f-f7510e3113ac tempest-VolumesSnapshotListTestJSON-1264774145 None] Created reservations ['77ee45d2-eefd-43ec-b942-8f059681267c', 'a58fc28c-f817-420c-b91f-a400e05a4e25', '8b7deb95-9f6c-47ef-9c28-2c9fb5a8a97b', '01d18476-7cdc-4cf9-93cc-b205e2d9792d'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:41 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-71b2d209-8d14-4938-9f1f-f7510e3113ac tempest-VolumesSnapshotListTestJSON-1264774145 None] Delete snapshot completed successfully. Sep 28 18:21:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-71b2d209-8d14-4938-9f1f-f7510e3113ac tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "cinder-6d1b37a9-3558-463c-9300-b3755f438234-delete_snapshot" released by "delete_snapshot" :: held 1.980s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:41 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-10ef768c-05a9-493a-8ef4-95616fc1fd24 tempest-CreateVolumesFromImageTest-717962176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-007bc5f9-2063-4955-8e7a-c332e1b3dbf4" returned: 0 in 0.484s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-10ef768c-05a9-493a-8ef4-95616fc1fd24 tempest-CreateVolumesFromImageTest-717962176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-007bc5f9-2063-4955-8e7a-c332e1b3dbf4 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:41 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-007bc5f9-2063-4955-8e7a-c332e1b3dbf4 Sep 28 18:21:41 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e52f437f-b2a6-43c1-8ce0-80d0bf347538 tempest-VolumesSnapshotListTestJSON-1264774145 None] Acquiring lock "cinder-a35b0144-7efd-4165-a71c-ed1d9e6d38f7-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e52f437f-b2a6-43c1-8ce0-80d0bf347538 tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "cinder-a35b0144-7efd-4165-a71c-ed1d9e6d38f7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e52f437f-b2a6-43c1-8ce0-80d0bf347538 tempest-VolumesSnapshotListTestJSON-1264774145 None] Acquiring lock "cinder-quobyte-a35b0144-7efd-4165-a71c-ed1d9e6d38f7" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e52f437f-b2a6-43c1-8ce0-80d0bf347538 tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "cinder-quobyte-a35b0144-7efd-4165-a71c-ed1d9e6d38f7" acquired by "delete_volume" :: waited 0.016s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:41 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be72b18-ed94-46d1-b52c-daa77f5f87e8]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e52f437f-b2a6-43c1-8ce0-80d0bf347538 tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:41 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-10ef768c-05a9-493a-8ef4-95616fc1fd24 tempest-CreateVolumesFromImageTest-717962176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-007bc5f9-2063-4955-8e7a-c332e1b3dbf4" returned: 0 in 0.289s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:41 devstack sudo[104082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7 Sep 28 18:21:41 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-10ef768c-05a9-493a-8ef4-95616fc1fd24 tempest-CreateVolumesFromImageTest-717962176 None] Lock "cinder-quobyte-007bc5f9-2063-4955-8e7a-c332e1b3dbf4" released by "delete_volume" :: held 0.820s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:41 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-10ef768c-05a9-493a-8ef4-95616fc1fd24 tempest-CreateVolumesFromImageTest-717962176 None] Created reservations ['3ffad9a2-7d04-412f-95e1-95fb83764b50', '877739d9-a967-4316-90ad-0710de555876', '08b7b0e7-a92b-42ee-9665-6f3598a59503', '36aa1783-8686-4a87-9752-9d5da38c1384'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-10ef768c-05a9-493a-8ef4-95616fc1fd24 tempest-CreateVolumesFromImageTest-717962176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-10ef768c-05a9-493a-8ef4-95616fc1fd24 tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:41 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-10ef768c-05a9-493a-8ef4-95616fc1fd24 tempest-CreateVolumesFromImageTest-717962176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:41 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-10ef768c-05a9-493a-8ef4-95616fc1fd24 tempest-CreateVolumesFromImageTest-717962176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-10ef768c-05a9-493a-8ef4-95616fc1fd24 tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-10ef768c-05a9-493a-8ef4-95616fc1fd24 tempest-CreateVolumesFromImageTest-717962176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:41 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:21:41 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a0d1291a-73fb-4ef1-8c27-75e2ab6edad7 tempest-CreateVolumesFromImageTest-717962176 None] Acquiring lock "cinder-f1b4d5a9-0100-4464-9cf1-60732f86210a-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:41 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a0d1291a-73fb-4ef1-8c27-75e2ab6edad7 tempest-CreateVolumesFromImageTest-717962176 None] Lock "cinder-f1b4d5a9-0100-4464-9cf1-60732f86210a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e52f437f-b2a6-43c1-8ce0-80d0bf347538 tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7" returned: 0 in 0.449s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e52f437f-b2a6-43c1-8ce0-80d0bf347538 tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:41 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7 Sep 28 18:21:41 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a0d1291a-73fb-4ef1-8c27-75e2ab6edad7 tempest-CreateVolumesFromImageTest-717962176 None] Acquiring lock "cinder-quobyte-f1b4d5a9-0100-4464-9cf1-60732f86210a" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a0d1291a-73fb-4ef1-8c27-75e2ab6edad7 tempest-CreateVolumesFromImageTest-717962176 None] Lock "cinder-quobyte-f1b4d5a9-0100-4464-9cf1-60732f86210a" acquired by "delete_volume" :: waited 0.021s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:42 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-10ef768c-05a9-493a-8ef4-95616fc1fd24 tempest-CreateVolumesFromImageTest-717962176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.307s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:42 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-10ef768c-05a9-493a-8ef4-95616fc1fd24 tempest-CreateVolumesFromImageTest-717962176 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:42 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-10ef768c-05a9-493a-8ef4-95616fc1fd24 tempest-CreateVolumesFromImageTest-717962176 None] Deleted volume successfully. Sep 28 18:21:42 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f479c3-6b22-4296-ad97-b1595dae52e0]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a0d1291a-73fb-4ef1-8c27-75e2ab6edad7 tempest-CreateVolumesFromImageTest-717962176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f1b4d5a9-0100-4464-9cf1-60732f86210a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-10ef768c-05a9-493a-8ef4-95616fc1fd24 tempest-CreateVolumesFromImageTest-717962176 None] Lock "cinder-007bc5f9-2063-4955-8e7a-c332e1b3dbf4-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:42 devstack sudo[104093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f1b4d5a9-0100-4464-9cf1-60732f86210a Sep 28 18:21:42 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:42 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e52f437f-b2a6-43c1-8ce0-80d0bf347538 tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-a35b0144-7efd-4165-a71c-ed1d9e6d38f7" returned: 0 in 0.323s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e52f437f-b2a6-43c1-8ce0-80d0bf347538 tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "cinder-quobyte-a35b0144-7efd-4165-a71c-ed1d9e6d38f7" released by "delete_volume" :: held 0.843s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:42 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-e52f437f-b2a6-43c1-8ce0-80d0bf347538 tempest-VolumesSnapshotListTestJSON-1264774145 None] Created reservations ['9d5fcc11-4d9a-41ac-9024-3464bfea6f3b', '3d20f6fc-e789-4f5d-9794-216d7ad54649', '9b4464f9-8a77-4a06-a316-10275dca931b', '78ae5df7-dd2e-48b7-8aae-defc6bad8164'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:42 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a0d1291a-73fb-4ef1-8c27-75e2ab6edad7 tempest-CreateVolumesFromImageTest-717962176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f1b4d5a9-0100-4464-9cf1-60732f86210a" returned: 0 in 0.420s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a0d1291a-73fb-4ef1-8c27-75e2ab6edad7 tempest-CreateVolumesFromImageTest-717962176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f1b4d5a9-0100-4464-9cf1-60732f86210a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e52f437f-b2a6-43c1-8ce0-80d0bf347538 tempest-VolumesSnapshotListTestJSON-1264774145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e52f437f-b2a6-43c1-8ce0-80d0bf347538 tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e52f437f-b2a6-43c1-8ce0-80d0bf347538 tempest-VolumesSnapshotListTestJSON-1264774145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e52f437f-b2a6-43c1-8ce0-80d0bf347538 tempest-VolumesSnapshotListTestJSON-1264774145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e52f437f-b2a6-43c1-8ce0-80d0bf347538 tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e52f437f-b2a6-43c1-8ce0-80d0bf347538 tempest-VolumesSnapshotListTestJSON-1264774145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:42 devstack sudo[104099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f1b4d5a9-0100-4464-9cf1-60732f86210a Sep 28 18:21:42 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:42 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:21:42 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:42 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a0d1291a-73fb-4ef1-8c27-75e2ab6edad7 tempest-CreateVolumesFromImageTest-717962176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f1b4d5a9-0100-4464-9cf1-60732f86210a" returned: 0 in 0.292s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a0d1291a-73fb-4ef1-8c27-75e2ab6edad7 tempest-CreateVolumesFromImageTest-717962176 None] Lock "cinder-quobyte-f1b4d5a9-0100-4464-9cf1-60732f86210a" released by "delete_volume" :: held 0.785s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:42 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e52f437f-b2a6-43c1-8ce0-80d0bf347538 tempest-VolumesSnapshotListTestJSON-1264774145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.305s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:42 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-e52f437f-b2a6-43c1-8ce0-80d0bf347538 tempest-VolumesSnapshotListTestJSON-1264774145 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:42 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-e52f437f-b2a6-43c1-8ce0-80d0bf347538 tempest-VolumesSnapshotListTestJSON-1264774145 None] Deleted volume successfully. Sep 28 18:21:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e52f437f-b2a6-43c1-8ce0-80d0bf347538 tempest-VolumesSnapshotListTestJSON-1264774145 None] Lock "cinder-a35b0144-7efd-4165-a71c-ed1d9e6d38f7-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:42 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-a0d1291a-73fb-4ef1-8c27-75e2ab6edad7 tempest-CreateVolumesFromImageTest-717962176 None] Created reservations ['b99c72ba-9bc6-40af-8ffc-db681d19b1ac', '8695e750-4f23-4fb8-9c19-9ea86f264710', 'f55b9fe8-df8a-429d-adcb-7449bb9d3159', 'f880791e-d9ad-40d9-9341-d2dd43c34c27'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a0d1291a-73fb-4ef1-8c27-75e2ab6edad7 tempest-CreateVolumesFromImageTest-717962176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a0d1291a-73fb-4ef1-8c27-75e2ab6edad7 tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a0d1291a-73fb-4ef1-8c27-75e2ab6edad7 tempest-CreateVolumesFromImageTest-717962176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a0d1291a-73fb-4ef1-8c27-75e2ab6edad7 tempest-CreateVolumesFromImageTest-717962176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a0d1291a-73fb-4ef1-8c27-75e2ab6edad7 tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a0d1291a-73fb-4ef1-8c27-75e2ab6edad7 tempest-CreateVolumesFromImageTest-717962176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:43 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:21:43 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-702068c0-2d84-4d9b-b642-9456cdac8ab1 tempest-CreateVolumesFromImageTest-717962176 None] Acquiring lock "cinder-60be9869-359b-4ef1-9b38-f9915bebcd63-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-702068c0-2d84-4d9b-b642-9456cdac8ab1 tempest-CreateVolumesFromImageTest-717962176 None] Lock "cinder-60be9869-359b-4ef1-9b38-f9915bebcd63-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-702068c0-2d84-4d9b-b642-9456cdac8ab1 tempest-CreateVolumesFromImageTest-717962176 None] Acquiring lock "cinder-quobyte-60be9869-359b-4ef1-9b38-f9915bebcd63" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-702068c0-2d84-4d9b-b642-9456cdac8ab1 tempest-CreateVolumesFromImageTest-717962176 None] Lock "cinder-quobyte-60be9869-359b-4ef1-9b38-f9915bebcd63" acquired by "delete_volume" :: waited 0.015s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:43 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d3ffb1-bcad-4335-9e35-a7093eae43fb]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-702068c0-2d84-4d9b-b642-9456cdac8ab1 tempest-CreateVolumesFromImageTest-717962176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-60be9869-359b-4ef1-9b38-f9915bebcd63 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:43 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a0d1291a-73fb-4ef1-8c27-75e2ab6edad7 tempest-CreateVolumesFromImageTest-717962176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.342s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:43 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-a0d1291a-73fb-4ef1-8c27-75e2ab6edad7 tempest-CreateVolumesFromImageTest-717962176 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:43 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-a0d1291a-73fb-4ef1-8c27-75e2ab6edad7 tempest-CreateVolumesFromImageTest-717962176 None] Deleted volume successfully. Sep 28 18:21:43 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-60be9869-359b-4ef1-9b38-f9915bebcd63 Sep 28 18:21:43 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a0d1291a-73fb-4ef1-8c27-75e2ab6edad7 tempest-CreateVolumesFromImageTest-717962176 None] Lock "cinder-f1b4d5a9-0100-4464-9cf1-60732f86210a-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:43 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-702068c0-2d84-4d9b-b642-9456cdac8ab1 tempest-CreateVolumesFromImageTest-717962176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-60be9869-359b-4ef1-9b38-f9915bebcd63" returned: 0 in 0.518s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-702068c0-2d84-4d9b-b642-9456cdac8ab1 tempest-CreateVolumesFromImageTest-717962176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-60be9869-359b-4ef1-9b38-f9915bebcd63 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:43 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-60be9869-359b-4ef1-9b38-f9915bebcd63 Sep 28 18:21:43 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:44 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-702068c0-2d84-4d9b-b642-9456cdac8ab1 tempest-CreateVolumesFromImageTest-717962176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-60be9869-359b-4ef1-9b38-f9915bebcd63" returned: 0 in 0.322s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:44 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-702068c0-2d84-4d9b-b642-9456cdac8ab1 tempest-CreateVolumesFromImageTest-717962176 None] Lock "cinder-quobyte-60be9869-359b-4ef1-9b38-f9915bebcd63" released by "delete_volume" :: held 0.901s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:44 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=118,cinder:INSERT=32,cinder:UPDATE=149,cinder:DELETE=9 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:21:44 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=118,cinder:INSERT=42,cinder:UPDATE=132,cinder:DELETE=12 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:21:44 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-702068c0-2d84-4d9b-b642-9456cdac8ab1 tempest-CreateVolumesFromImageTest-717962176 None] Created reservations ['e9c24cd7-fcd0-47dc-b5a6-a673d60dec85', 'd5e4e20b-e186-4c6f-a833-81912aaa25c9', 'e8e6554c-560a-46b3-a707-a3e99f930f8a', '841f3033-738e-489e-add7-9196dc97ef5d'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-702068c0-2d84-4d9b-b642-9456cdac8ab1 tempest-CreateVolumesFromImageTest-717962176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-702068c0-2d84-4d9b-b642-9456cdac8ab1 tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:44 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-702068c0-2d84-4d9b-b642-9456cdac8ab1 tempest-CreateVolumesFromImageTest-717962176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:44 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-702068c0-2d84-4d9b-b642-9456cdac8ab1 tempest-CreateVolumesFromImageTest-717962176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-702068c0-2d84-4d9b-b642-9456cdac8ab1 tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-702068c0-2d84-4d9b-b642-9456cdac8ab1 tempest-CreateVolumesFromImageTest-717962176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:44 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:21:44 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:44 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-48c60ab4-1936-4182-99f3-539f052b4b6e tempest-CreateVolumesFromImageTest-717962176 None] Acquiring lock "cinder-4b595efb-39f3-49c6-83aa-5e07606c6f69-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:44 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-48c60ab4-1936-4182-99f3-539f052b4b6e tempest-CreateVolumesFromImageTest-717962176 None] Lock "cinder-4b595efb-39f3-49c6-83aa-5e07606c6f69-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:44 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-48c60ab4-1936-4182-99f3-539f052b4b6e tempest-CreateVolumesFromImageTest-717962176 None] Acquiring lock "cinder-quobyte-4b595efb-39f3-49c6-83aa-5e07606c6f69" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:44 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-48c60ab4-1936-4182-99f3-539f052b4b6e tempest-CreateVolumesFromImageTest-717962176 None] Lock "cinder-quobyte-4b595efb-39f3-49c6-83aa-5e07606c6f69" acquired by "delete_volume" :: waited 0.039s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:44 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1538ffcd-ee20-43a1-92ea-90f184acb203]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-48c60ab4-1936-4182-99f3-539f052b4b6e tempest-CreateVolumesFromImageTest-717962176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b595efb-39f3-49c6-83aa-5e07606c6f69 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:44 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-702068c0-2d84-4d9b-b642-9456cdac8ab1 tempest-CreateVolumesFromImageTest-717962176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.381s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:44 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-702068c0-2d84-4d9b-b642-9456cdac8ab1 tempest-CreateVolumesFromImageTest-717962176 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:44 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-702068c0-2d84-4d9b-b642-9456cdac8ab1 tempest-CreateVolumesFromImageTest-717962176 None] Deleted volume successfully. Sep 28 18:21:44 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-702068c0-2d84-4d9b-b642-9456cdac8ab1 tempest-CreateVolumesFromImageTest-717962176 None] Lock "cinder-60be9869-359b-4ef1-9b38-f9915bebcd63-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:44 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b595efb-39f3-49c6-83aa-5e07606c6f69 Sep 28 18:21:44 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:45 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-48c60ab4-1936-4182-99f3-539f052b4b6e tempest-CreateVolumesFromImageTest-717962176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b595efb-39f3-49c6-83aa-5e07606c6f69" returned: 0 in 0.541s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-48c60ab4-1936-4182-99f3-539f052b4b6e tempest-CreateVolumesFromImageTest-717962176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b595efb-39f3-49c6-83aa-5e07606c6f69 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:45 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b595efb-39f3-49c6-83aa-5e07606c6f69 Sep 28 18:21:45 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:45 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-48c60ab4-1936-4182-99f3-539f052b4b6e tempest-CreateVolumesFromImageTest-717962176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b595efb-39f3-49c6-83aa-5e07606c6f69" returned: 0 in 0.321s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:45 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-48c60ab4-1936-4182-99f3-539f052b4b6e tempest-CreateVolumesFromImageTest-717962176 None] Lock "cinder-quobyte-4b595efb-39f3-49c6-83aa-5e07606c6f69" released by "delete_volume" :: held 0.927s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:45 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-48c60ab4-1936-4182-99f3-539f052b4b6e tempest-CreateVolumesFromImageTest-717962176 None] Created reservations ['a2fea319-8a83-4d8e-91f2-b72851582279', '16cc31d2-302d-4b1a-9f98-a728394ebf19', '06c046c6-1644-4868-9744-b5de1709101e', 'a37355a7-1fcd-47ef-8113-deb07c19d594'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-48c60ab4-1936-4182-99f3-539f052b4b6e tempest-CreateVolumesFromImageTest-717962176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-48c60ab4-1936-4182-99f3-539f052b4b6e tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:45 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-48c60ab4-1936-4182-99f3-539f052b4b6e tempest-CreateVolumesFromImageTest-717962176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:45 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-48c60ab4-1936-4182-99f3-539f052b4b6e tempest-CreateVolumesFromImageTest-717962176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-48c60ab4-1936-4182-99f3-539f052b4b6e tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-48c60ab4-1936-4182-99f3-539f052b4b6e tempest-CreateVolumesFromImageTest-717962176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:45 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:21:45 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:45 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-48c60ab4-1936-4182-99f3-539f052b4b6e tempest-CreateVolumesFromImageTest-717962176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.270s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:45 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-48c60ab4-1936-4182-99f3-539f052b4b6e tempest-CreateVolumesFromImageTest-717962176 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:45 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-48c60ab4-1936-4182-99f3-539f052b4b6e tempest-CreateVolumesFromImageTest-717962176 None] Deleted volume successfully. Sep 28 18:21:45 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-48c60ab4-1936-4182-99f3-539f052b4b6e tempest-CreateVolumesFromImageTest-717962176 None] Lock "cinder-4b595efb-39f3-49c6-83aa-5e07606c6f69-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:46 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5bbae1e9-f05f-4782-870b-98b2974dc1d0 tempest-CreateVolumesFromImageTest-717962176 None] Acquiring lock "cinder-4fdacca2-6fce-4374-a205-6b645a04b7a6-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:46 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5bbae1e9-f05f-4782-870b-98b2974dc1d0 tempest-CreateVolumesFromImageTest-717962176 None] Lock "cinder-4fdacca2-6fce-4374-a205-6b645a04b7a6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:46 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5bbae1e9-f05f-4782-870b-98b2974dc1d0 tempest-CreateVolumesFromImageTest-717962176 None] Acquiring lock "cinder-quobyte-4fdacca2-6fce-4374-a205-6b645a04b7a6" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:21:46 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5bbae1e9-f05f-4782-870b-98b2974dc1d0 tempest-CreateVolumesFromImageTest-717962176 None] Lock "cinder-quobyte-4fdacca2-6fce-4374-a205-6b645a04b7a6" acquired by "delete_volume" :: waited 0.023s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:21:46 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af3e5c7-3d01-4b28-b4ec-89379a2a5411]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5bbae1e9-f05f-4782-870b-98b2974dc1d0 tempest-CreateVolumesFromImageTest-717962176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4fdacca2-6fce-4374-a205-6b645a04b7a6 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:47 devstack sudo[104133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4fdacca2-6fce-4374-a205-6b645a04b7a6 Sep 28 18:21:47 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:47 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5bbae1e9-f05f-4782-870b-98b2974dc1d0 tempest-CreateVolumesFromImageTest-717962176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4fdacca2-6fce-4374-a205-6b645a04b7a6" returned: 0 in 0.501s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5bbae1e9-f05f-4782-870b-98b2974dc1d0 tempest-CreateVolumesFromImageTest-717962176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4fdacca2-6fce-4374-a205-6b645a04b7a6 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:47 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4fdacca2-6fce-4374-a205-6b645a04b7a6 Sep 28 18:21:47 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:47 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5bbae1e9-f05f-4782-870b-98b2974dc1d0 tempest-CreateVolumesFromImageTest-717962176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4fdacca2-6fce-4374-a205-6b645a04b7a6" returned: 0 in 0.307s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5bbae1e9-f05f-4782-870b-98b2974dc1d0 tempest-CreateVolumesFromImageTest-717962176 None] Lock "cinder-quobyte-4fdacca2-6fce-4374-a205-6b645a04b7a6" released by "delete_volume" :: held 0.869s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:47 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-5bbae1e9-f05f-4782-870b-98b2974dc1d0 tempest-CreateVolumesFromImageTest-717962176 None] Created reservations ['b4f5423c-e3f2-4001-82a5-8747eee06e1e', 'f9b68ce9-188e-498c-8339-bcec44cbddd9', '28febf70-cb93-47df-b926-5e3946ee778f', '53855a47-3cc6-44dc-aa0e-e6c3a435d53d'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:21:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5bbae1e9-f05f-4782-870b-98b2974dc1d0 tempest-CreateVolumesFromImageTest-717962176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5bbae1e9-f05f-4782-870b-98b2974dc1d0 tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:47 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-5bbae1e9-f05f-4782-870b-98b2974dc1d0 tempest-CreateVolumesFromImageTest-717962176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:47 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-5bbae1e9-f05f-4782-870b-98b2974dc1d0 tempest-CreateVolumesFromImageTest-717962176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5bbae1e9-f05f-4782-870b-98b2974dc1d0 tempest-CreateVolumesFromImageTest-717962176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5bbae1e9-f05f-4782-870b-98b2974dc1d0 tempest-CreateVolumesFromImageTest-717962176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:47 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:21:47 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:48 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5bbae1e9-f05f-4782-870b-98b2974dc1d0 tempest-CreateVolumesFromImageTest-717962176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.348s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:48 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-5bbae1e9-f05f-4782-870b-98b2974dc1d0 tempest-CreateVolumesFromImageTest-717962176 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:21:48 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-5bbae1e9-f05f-4782-870b-98b2974dc1d0 tempest-CreateVolumesFromImageTest-717962176 None] Deleted volume successfully. Sep 28 18:21:48 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5bbae1e9-f05f-4782-870b-98b2974dc1d0 tempest-CreateVolumesFromImageTest-717962176 None] Lock "cinder-4fdacca2-6fce-4374-a205-6b645a04b7a6-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:21:51 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Flow 'volume_create_manager' (58408d8f-debd-4c71-976f-39b4ab27b20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec27cafd-bc7c-4106-a268-767c36298097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec27cafd-bc7c-4106-a268-767c36298097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-283756196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88f0bf45-3dcc-483e-9b69-8f692c28f846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b18eaa198b4ed9ab5ef0ede7b0271a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:52Z,use_quota=True,user_id='4418298885394dd8949151c2d05d1709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c385cdd9-e9b1-4f27-bf31-fd39ed97ed60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c385cdd9-e9b1-4f27-bf31-fd39ed97ed60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c189861-3a53-4097-8f05-66de2d4c3c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c189861-3a53-4097-8f05-66de2d4c3c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88f0bf45-3dcc-483e-9b69-8f692c28f846', 'volume_name': 'volume-88f0bf45-3dcc-483e-9b69-8f692c28f846', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea391c91-ca86-4c4c-8519-30c42d5891e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea391c91-ca86-4c4c-8519-30c42d5891e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78976137-7c57-4446-ad51-cc3fd194d83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:52 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Volume 88f0bf45-3dcc-483e-9b69-8f692c28f846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88f0bf45-3dcc-483e-9b69-8f692c28f846', 'volume_size': 1} Sep 28 18:21:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:52 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-283756196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88f0bf45-3dcc-483e-9b69-8f692c28f846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b18eaa198b4ed9ab5ef0ede7b0271a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:52Z,use_quota=True,user_id='4418298885394dd8949151c2d05d1709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:52 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Creating volume 88f0bf45-3dcc-483e-9b69-8f692c28f846 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:52 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:52 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:52 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:52 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:21:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:52 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846 1073741824 Sep 28 18:21:52 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:52 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846 1073741824" returned: 0 in 0.557s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:52 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846 Sep 28 18:21:52 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:52 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846" returned: 0 in 0.295s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:52 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78976137-7c57-4446-ad51-cc3fd194d83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88f0bf45-3dcc-483e-9b69-8f692c28f846', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfdcf182-58fc-490d-894b-05722f59c5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:52 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Volume volume-88f0bf45-3dcc-483e-9b69-8f692c28f846 (88f0bf45-3dcc-483e-9b69-8f692c28f846): created successfully Sep 28 18:21:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfdcf182-58fc-490d-894b-05722f59c5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:53 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Flow 'volume_create_manager' (58408d8f-debd-4c71-976f-39b4ab27b20d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:53 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-057843d8-616b-499a-9ffd-f39301250ead tempest-CreateVolumesFromSnapshotTest-1272795543 None] Created volume successfully. Sep 28 18:21:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f6921aba-f2c9-4c0e-a900-42cb20ce1574 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f6921aba-f2c9-4c0e-a900-42cb20ce1574 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-f6921aba-f2c9-4c0e-a900-42cb20ce1574 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Creating offline snapshot d7d54930-8b59-4b45-9118-0aaff3c0bca0 of volume 88f0bf45-3dcc-483e-9b69-8f692c28f846 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:21:54 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c79124f-5b52-402f-8c98-08dadba003ab]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:21:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f6921aba-f2c9-4c0e-a900-42cb20ce1574 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:54 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846 Sep 28 18:21:54 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:54 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f6921aba-f2c9-4c0e-a900-42cb20ce1574 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846" returned: 0 in 0.454s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f6921aba-f2c9-4c0e-a900-42cb20ce1574 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846.d7d54930-8b59-4b45-9118-0aaff3c0bca0 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:54 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846.d7d54930-8b59-4b45-9118-0aaff3c0bca0 1G Sep 28 18:21:54 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:55 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f6921aba-f2c9-4c0e-a900-42cb20ce1574 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846.d7d54930-8b59-4b45-9118-0aaff3c0bca0 1G" returned: 0 in 0.630s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f6921aba-f2c9-4c0e-a900-42cb20ce1574 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88f0bf45-3dcc-483e-9b69-8f692c28f846 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846.d7d54930-8b59-4b45-9118-0aaff3c0bca0 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:55 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88f0bf45-3dcc-483e-9b69-8f692c28f846 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846.d7d54930-8b59-4b45-9118-0aaff3c0bca0 Sep 28 18:21:55 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:55 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f6921aba-f2c9-4c0e-a900-42cb20ce1574 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88f0bf45-3dcc-483e-9b69-8f692c28f846 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846.d7d54930-8b59-4b45-9118-0aaff3c0bca0" returned: 0 in 0.390s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:55 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-f6921aba-f2c9-4c0e-a900-42cb20ce1574 tempest-CreateVolumesFromSnapshotTest-1272795543 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846.d7d54930-8b59-4b45-9118-0aaff3c0bca0 is being set with open permissions: ugo+rw Sep 28 18:21:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f6921aba-f2c9-4c0e-a900-42cb20ce1574 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846.d7d54930-8b59-4b45-9118-0aaff3c0bca0 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:55 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846.d7d54930-8b59-4b45-9118-0aaff3c0bca0 Sep 28 18:21:55 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:56 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f6921aba-f2c9-4c0e-a900-42cb20ce1574 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846.d7d54930-8b59-4b45-9118-0aaff3c0bca0" returned: 0 in 0.338s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f6921aba-f2c9-4c0e-a900-42cb20ce1574 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:56 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846.info Sep 28 18:21:56 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:56 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f6921aba-f2c9-4c0e-a900-42cb20ce1574 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846.info" returned: 0 in 0.350s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:56 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-f6921aba-f2c9-4c0e-a900-42cb20ce1574 tempest-CreateVolumesFromSnapshotTest-1272795543 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846.info is being set with open permissions: ugo+rw Sep 28 18:21:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f6921aba-f2c9-4c0e-a900-42cb20ce1574 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:56 devstack sudo[104177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846.info Sep 28 18:21:56 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:56 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f6921aba-f2c9-4c0e-a900-42cb20ce1574 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846.info" returned: 0 in 0.371s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f6921aba-f2c9-4c0e-a900-42cb20ce1574 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.663s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:56 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-f6921aba-f2c9-4c0e-a900-42cb20ce1574 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Create snapshot completed successfully Sep 28 18:21:58 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Flow 'volume_create_manager' (92a0179b-7cab-4c5d-9613-79f8e8717560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a593ac1-5178-483c-acad-3ac8e8381611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a593ac1-5178-483c-acad-3ac8e8381611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-110814779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44534af0-544f-4a23-b58b-6942e85b0780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b18eaa198b4ed9ab5ef0ede7b0271a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:58Z,use_quota=True,user_id='4418298885394dd8949151c2d05d1709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0174c8-ae47-4abe-ae3c-b803c5dadcec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0174c8-ae47-4abe-ae3c-b803c5dadcec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ec1a94-cd23-4ba8-ab58-a37afac570d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ec1a94-cd23-4ba8-ab58-a37afac570d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44534af0-544f-4a23-b58b-6942e85b0780', 'volume_name': 'volume-44534af0-544f-4a23-b58b-6942e85b0780', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe40215f-a791-4b5b-9ab2-a9617f9de4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe40215f-a791-4b5b-9ab2-a9617f9de4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e9d8451-d84d-47bc-9c27-369e336de920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:58 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Volume 44534af0-544f-4a23-b58b-6942e85b0780: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44534af0-544f-4a23-b58b-6942e85b0780', 'volume_size': 1} Sep 28 18:21:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-110814779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44534af0-544f-4a23-b58b-6942e85b0780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b18eaa198b4ed9ab5ef0ede7b0271a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:58Z,use_quota=True,user_id='4418298885394dd8949151c2d05d1709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Creating volume 44534af0-544f-4a23-b58b-6942e85b0780 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:58 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:21:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-44534af0-544f-4a23-b58b-6942e85b0780 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:58 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-44534af0-544f-4a23-b58b-6942e85b0780 1073741824 Sep 28 18:21:58 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:58 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Flow 'volume_create_manager' (269f57c5-df33-4d63-9f7d-f3cfdfa56878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde5d747-1dca-4fa4-a5ee-9dbd21f8bc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde5d747-1dca-4fa4-a5ee-9dbd21f8bc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-402147279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a818cdd-e926-46ff-b7e8-3a30e5750b60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b18eaa198b4ed9ab5ef0ede7b0271a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:59Z,use_quota=True,user_id='4418298885394dd8949151c2d05d1709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:59 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a94a8122-ce6b-481e-a356-741676a30037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a94a8122-ce6b-481e-a356-741676a30037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6705fc-c457-4216-91c2-6bf68201d534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6705fc-c457-4216-91c2-6bf68201d534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a818cdd-e926-46ff-b7e8-3a30e5750b60', 'volume_name': 'volume-5a818cdd-e926-46ff-b7e8-3a30e5750b60', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b04996-919a-4a66-8daf-0006c30c8205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b04996-919a-4a66-8daf-0006c30c8205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (758eb078-9ac5-4367-9f37-0c1fff808bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:59 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Volume 5a818cdd-e926-46ff-b7e8-3a30e5750b60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a818cdd-e926-46ff-b7e8-3a30e5750b60', 'volume_size': 1} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-44534af0-544f-4a23-b58b-6942e85b0780 1073741824" returned: 0 in 0.801s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-44534af0-544f-4a23-b58b-6942e85b0780 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:59 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-44534af0-544f-4a23-b58b-6942e85b0780 Sep 28 18:21:59 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Flow 'volume_create_manager' (53dd6bb5-a18b-4b64-87d1-950a7282ad4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a00019-7cb2-41d4-b3c6-bc665ec5fb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a00019-7cb2-41d4-b3c6-bc665ec5fb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1354671736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c2c4d2-8591-4154-86a6-f914273b3ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b18eaa198b4ed9ab5ef0ede7b0271a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:59Z,use_quota=True,user_id='4418298885394dd8949151c2d05d1709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a6ad7d7-1006-4a0d-a833-269b978903b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a6ad7d7-1006-4a0d-a833-269b978903b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da41ce49-e3e4-485b-af60-c121939b8dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da41ce49-e3e4-485b-af60-c121939b8dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3c2c4d2-8591-4154-86a6-f914273b3ee7', 'volume_name': 'volume-b3c2c4d2-8591-4154-86a6-f914273b3ee7', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17843147-2afb-41ae-b020-9527f079d623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17843147-2afb-41ae-b020-9527f079d623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a1e1f9d-3429-4692-9b49-071f059a1d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:59 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Volume b3c2c4d2-8591-4154-86a6-f914273b3ee7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3c2c4d2-8591-4154-86a6-f914273b3ee7', 'volume_size': 1} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:59 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-44534af0-544f-4a23-b58b-6942e85b0780" returned: 0 in 0.633s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.686s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-402147279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a818cdd-e926-46ff-b7e8-3a30e5750b60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b18eaa198b4ed9ab5ef0ede7b0271a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:59Z,use_quota=True,user_id='4418298885394dd8949151c2d05d1709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Creating volume 5a818cdd-e926-46ff-b7e8-3a30e5750b60 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:21:59 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a818cdd-e926-46ff-b7e8-3a30e5750b60 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e9d8451-d84d-47bc-9c27-369e336de920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44534af0-544f-4a23-b58b-6942e85b0780', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:59 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a818cdd-e926-46ff-b7e8-3a30e5750b60 1073741824 Sep 28 18:21:59 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (438f900d-b686-4d65-98b8-098b30b7ebf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:21:59 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Volume volume-44534af0-544f-4a23-b58b-6942e85b0780 (44534af0-544f-4a23-b58b-6942e85b0780): created successfully Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (438f900d-b686-4d65-98b8-098b30b7ebf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:21:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Flow 'volume_create_manager' (92a0179b-7cab-4c5d-9613-79f8e8717560) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:00 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-6eb03c65-f628-4f1a-a582-1c03f0377563 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Created volume successfully. Sep 28 18:22:00 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Flow 'volume_create_manager' (2ed7feb7-4c3f-4424-99a3-af0ae3beb293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4028146-556a-46ad-a101-611cefabf34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4028146-556a-46ad-a101-611cefabf34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1407935774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b12b748-1086-4225-884a-f139114256fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b18eaa198b4ed9ab5ef0ede7b0271a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:00Z,use_quota=True,user_id='4418298885394dd8949151c2d05d1709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ed8c3d-db66-433a-813b-1fb49c193afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ed8c3d-db66-433a-813b-1fb49c193afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc08d3d-5b8f-4f8c-ace9-b6109bc2b359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc08d3d-5b8f-4f8c-ace9-b6109bc2b359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b12b748-1086-4225-884a-f139114256fb', 'volume_name': 'volume-4b12b748-1086-4225-884a-f139114256fb', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302c790c-6cbd-48c8-95b2-1be8deab3c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302c790c-6cbd-48c8-95b2-1be8deab3c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55afea97-611d-4f1a-a3c8-d6c05f30aa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:00 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Volume 4b12b748-1086-4225-884a-f139114256fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b12b748-1086-4225-884a-f139114256fb', 'volume_size': 1} Sep 28 18:22:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:00 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a818cdd-e926-46ff-b7e8-3a30e5750b60 1073741824" returned: 0 in 0.939s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a818cdd-e926-46ff-b7e8-3a30e5750b60 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:00 devstack sudo[104237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a818cdd-e926-46ff-b7e8-3a30e5750b60 Sep 28 18:22:00 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:00 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Flow 'volume_create_manager' (05d979b5-149a-4729-8096-dbafa07e9061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1629f7fd-9a10-41bd-ae77-e9df6c0dc02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1629f7fd-9a10-41bd-ae77-e9df6c0dc02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1997400387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b8cf1a-bbd7-46c7-a0a0-ee988a2ec9af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b18eaa198b4ed9ab5ef0ede7b0271a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:01Z,use_quota=True,user_id='4418298885394dd8949151c2d05d1709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df93c7c2-636b-44db-861d-865cf82d0997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df93c7c2-636b-44db-861d-865cf82d0997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ccad0e-9d48-4b0e-b0e1-99fcbe1b94b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ccad0e-9d48-4b0e-b0e1-99fcbe1b94b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74b8cf1a-bbd7-46c7-a0a0-ee988a2ec9af', 'volume_name': 'volume-74b8cf1a-bbd7-46c7-a0a0-ee988a2ec9af', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ec0749-7b1f-47ad-aeea-c0c4289ddadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ec0749-7b1f-47ad-aeea-c0c4289ddadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80e0016b-e15c-4e9c-bb15-d3fcb1b02bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:00 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Volume 74b8cf1a-bbd7-46c7-a0a0-ee988a2ec9af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74b8cf1a-bbd7-46c7-a0a0-ee988a2ec9af', 'volume_size': 1} Sep 28 18:22:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:01 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a818cdd-e926-46ff-b7e8-3a30e5750b60" returned: 0 in 0.271s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.327s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1354671736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c2c4d2-8591-4154-86a6-f914273b3ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b18eaa198b4ed9ab5ef0ede7b0271a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:21:59Z,use_quota=True,user_id='4418298885394dd8949151c2d05d1709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Creating volume b3c2c4d2-8591-4154-86a6-f914273b3ee7 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:01 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:22:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b3c2c4d2-8591-4154-86a6-f914273b3ee7 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:01 devstack sudo[104240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b3c2c4d2-8591-4154-86a6-f914273b3ee7 1073741824 Sep 28 18:22:01 devstack sudo[104240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (758eb078-9ac5-4367-9f37-0c1fff808bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a818cdd-e926-46ff-b7e8-3a30e5750b60', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47b54300-b866-4747-b932-177560403a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:01 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Volume volume-5a818cdd-e926-46ff-b7e8-3a30e5750b60 (5a818cdd-e926-46ff-b7e8-3a30e5750b60): created successfully Sep 28 18:22:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47b54300-b866-4747-b932-177560403a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Flow 'volume_create_manager' (269f57c5-df33-4d63-9f7d-f3cfdfa56878) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:01 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-11282371-4157-4ef5-826b-079045ba08e4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Created volume successfully. Sep 28 18:22:01 devstack sudo[104240]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b3c2c4d2-8591-4154-86a6-f914273b3ee7 1073741824" returned: 0 in 0.557s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b3c2c4d2-8591-4154-86a6-f914273b3ee7 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:01 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b3c2c4d2-8591-4154-86a6-f914273b3ee7 Sep 28 18:22:01 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:02 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b3c2c4d2-8591-4154-86a6-f914273b3ee7" returned: 0 in 0.415s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.833s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1407935774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b12b748-1086-4225-884a-f139114256fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b18eaa198b4ed9ab5ef0ede7b0271a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:00Z,use_quota=True,user_id='4418298885394dd8949151c2d05d1709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Creating volume 4b12b748-1086-4225-884a-f139114256fb {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:02 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:22:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b12b748-1086-4225-884a-f139114256fb 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a1e1f9d-3429-4692-9b49-071f059a1d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3c2c4d2-8591-4154-86a6-f914273b3ee7', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e69c71-9cf6-41ea-9c16-3931569f6d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:02 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b12b748-1086-4225-884a-f139114256fb 1073741824 Sep 28 18:22:02 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:02 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Volume volume-b3c2c4d2-8591-4154-86a6-f914273b3ee7 (b3c2c4d2-8591-4154-86a6-f914273b3ee7): created successfully Sep 28 18:22:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e69c71-9cf6-41ea-9c16-3931569f6d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Flow 'volume_create_manager' (53dd6bb5-a18b-4b64-87d1-950a7282ad4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:02 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-694b234f-6be6-4299-b336-e936dd2ed8d4 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Created volume successfully. Sep 28 18:22:02 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b12b748-1086-4225-884a-f139114256fb 1073741824" returned: 0 in 0.596s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b12b748-1086-4225-884a-f139114256fb {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:02 devstack sudo[104256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b12b748-1086-4225-884a-f139114256fb Sep 28 18:22:02 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:03 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b12b748-1086-4225-884a-f139114256fb" returned: 0 in 0.328s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.167s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1997400387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b8cf1a-bbd7-46c7-a0a0-ee988a2ec9af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b18eaa198b4ed9ab5ef0ede7b0271a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:01Z,use_quota=True,user_id='4418298885394dd8949151c2d05d1709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Creating volume 74b8cf1a-bbd7-46c7-a0a0-ee988a2ec9af {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:03 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:22:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-74b8cf1a-bbd7-46c7-a0a0-ee988a2ec9af 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55afea97-611d-4f1a-a3c8-d6c05f30aa27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b12b748-1086-4225-884a-f139114256fb', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a47ffc40-c1a5-442c-bb70-acda183731cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:03 devstack sudo[104259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-74b8cf1a-bbd7-46c7-a0a0-ee988a2ec9af 1073741824 Sep 28 18:22:03 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:03 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Volume volume-4b12b748-1086-4225-884a-f139114256fb (4b12b748-1086-4225-884a-f139114256fb): created successfully Sep 28 18:22:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a47ffc40-c1a5-442c-bb70-acda183731cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Flow 'volume_create_manager' (2ed7feb7-4c3f-4424-99a3-af0ae3beb293) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:03 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-31cd1adc-0587-4f6e-bf8e-6f18348300f8 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Created volume successfully. Sep 28 18:22:03 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-74b8cf1a-bbd7-46c7-a0a0-ee988a2ec9af 1073741824" returned: 0 in 0.628s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-74b8cf1a-bbd7-46c7-a0a0-ee988a2ec9af {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:03 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-74b8cf1a-bbd7-46c7-a0a0-ee988a2ec9af Sep 28 18:22:03 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:04 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-74b8cf1a-bbd7-46c7-a0a0-ee988a2ec9af" returned: 0 in 0.300s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80e0016b-e15c-4e9c-bb15-d3fcb1b02bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74b8cf1a-bbd7-46c7-a0a0-ee988a2ec9af', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2091a31-4486-4cca-a170-da45403f02ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:04 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Volume volume-74b8cf1a-bbd7-46c7-a0a0-ee988a2ec9af (74b8cf1a-bbd7-46c7-a0a0-ee988a2ec9af): created successfully Sep 28 18:22:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2091a31-4486-4cca-a170-da45403f02ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Flow 'volume_create_manager' (05d979b5-149a-4729-8096-dbafa07e9061) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:04 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-d2468653-bc34-42c4-b135-999573baa5fd tempest-CreateVolumesFromSnapshotTest-1272795543 None] Created volume successfully. Sep 28 18:22:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-75e6870d-e046-4c4f-a308-14da7e93fb02 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "cinder-74b8cf1a-bbd7-46c7-a0a0-ee988a2ec9af-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-75e6870d-e046-4c4f-a308-14da7e93fb02 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-74b8cf1a-bbd7-46c7-a0a0-ee988a2ec9af-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-75e6870d-e046-4c4f-a308-14da7e93fb02 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "cinder-quobyte-74b8cf1a-bbd7-46c7-a0a0-ee988a2ec9af" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-75e6870d-e046-4c4f-a308-14da7e93fb02 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-quobyte-74b8cf1a-bbd7-46c7-a0a0-ee988a2ec9af" acquired by "delete_volume" :: waited 0.016s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:04 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb5903c-ec7c-4254-9f3b-64e3f3f2ed1f]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-75e6870d-e046-4c4f-a308-14da7e93fb02 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-74b8cf1a-bbd7-46c7-a0a0-ee988a2ec9af {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:22:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:04 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:22:04 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:04 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-74b8cf1a-bbd7-46c7-a0a0-ee988a2ec9af Sep 28 18:22:04 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:04 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.291s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:04 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager._thread_info {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:22:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread count: 28 {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:22:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread info: [<_MainThread(MainThread, started 129097393381504)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:22:04 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-75e6870d-e046-4c4f-a308-14da7e93fb02 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-74b8cf1a-bbd7-46c7-a0a0-ee988a2ec9af" returned: 0 in 0.412s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-75e6870d-e046-4c4f-a308-14da7e93fb02 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-74b8cf1a-bbd7-46c7-a0a0-ee988a2ec9af {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:04 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-74b8cf1a-bbd7-46c7-a0a0-ee988a2ec9af Sep 28 18:22:04 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:05 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-75e6870d-e046-4c4f-a308-14da7e93fb02 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-74b8cf1a-bbd7-46c7-a0a0-ee988a2ec9af" returned: 0 in 0.274s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-75e6870d-e046-4c4f-a308-14da7e93fb02 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-quobyte-74b8cf1a-bbd7-46c7-a0a0-ee988a2ec9af" released by "delete_volume" :: held 0.737s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:05 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-75e6870d-e046-4c4f-a308-14da7e93fb02 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Created reservations ['cef8da9e-9689-44a8-b01d-08289bfddc92', 'fe167e11-7516-4a8e-be46-c6268c1d2cdf', '8773aded-6ea3-46d2-aea0-093056cacccd', '60878d21-1468-4ee2-91ac-730c9de8552b'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-75e6870d-e046-4c4f-a308-14da7e93fb02 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-75e6870d-e046-4c4f-a308-14da7e93fb02 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-75e6870d-e046-4c4f-a308-14da7e93fb02 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-75e6870d-e046-4c4f-a308-14da7e93fb02 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-75e6870d-e046-4c4f-a308-14da7e93fb02 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-75e6870d-e046-4c4f-a308-14da7e93fb02 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:05 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:22:05 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ba5aa358-95c7-47f3-8e0e-ce3af3cdda29 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "cinder-4b12b748-1086-4225-884a-f139114256fb-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ba5aa358-95c7-47f3-8e0e-ce3af3cdda29 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-4b12b748-1086-4225-884a-f139114256fb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:05 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-75e6870d-e046-4c4f-a308-14da7e93fb02 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.331s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:05 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-75e6870d-e046-4c4f-a308-14da7e93fb02 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ba5aa358-95c7-47f3-8e0e-ce3af3cdda29 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "cinder-quobyte-4b12b748-1086-4225-884a-f139114256fb" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:05 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-75e6870d-e046-4c4f-a308-14da7e93fb02 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Deleted volume successfully. Sep 28 18:22:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ba5aa358-95c7-47f3-8e0e-ce3af3cdda29 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-quobyte-4b12b748-1086-4225-884a-f139114256fb" acquired by "delete_volume" :: waited 0.027s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-75e6870d-e046-4c4f-a308-14da7e93fb02 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-74b8cf1a-bbd7-46c7-a0a0-ee988a2ec9af-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:05 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b848298-f845-4519-9932-00bb33c878e3]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ba5aa358-95c7-47f3-8e0e-ce3af3cdda29 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b12b748-1086-4225-884a-f139114256fb {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:05 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b12b748-1086-4225-884a-f139114256fb Sep 28 18:22:05 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:06 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ba5aa358-95c7-47f3-8e0e-ce3af3cdda29 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b12b748-1086-4225-884a-f139114256fb" returned: 0 in 0.423s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ba5aa358-95c7-47f3-8e0e-ce3af3cdda29 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b12b748-1086-4225-884a-f139114256fb {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:06 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b12b748-1086-4225-884a-f139114256fb Sep 28 18:22:06 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:06 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ba5aa358-95c7-47f3-8e0e-ce3af3cdda29 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b12b748-1086-4225-884a-f139114256fb" returned: 0 in 0.294s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ba5aa358-95c7-47f3-8e0e-ce3af3cdda29 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-quobyte-4b12b748-1086-4225-884a-f139114256fb" released by "delete_volume" :: held 0.779s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:06 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-ba5aa358-95c7-47f3-8e0e-ce3af3cdda29 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Created reservations ['95913987-cb63-46e8-a489-e206f0bf5e3b', 'c7a59492-a5c4-46b7-a04d-039460a9dea9', '3c1d65ca-ec50-4841-8c95-9aa4bcc4fa3a', '868fa29f-5e1e-4431-9722-876985fe04f1'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ba5aa358-95c7-47f3-8e0e-ce3af3cdda29 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ba5aa358-95c7-47f3-8e0e-ce3af3cdda29 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ba5aa358-95c7-47f3-8e0e-ce3af3cdda29 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ba5aa358-95c7-47f3-8e0e-ce3af3cdda29 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ba5aa358-95c7-47f3-8e0e-ce3af3cdda29 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ba5aa358-95c7-47f3-8e0e-ce3af3cdda29 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:06 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:22:06 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e069fd75-2fab-42c8-bbb2-8a1bcca01896 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "cinder-b3c2c4d2-8591-4154-86a6-f914273b3ee7-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e069fd75-2fab-42c8-bbb2-8a1bcca01896 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-b3c2c4d2-8591-4154-86a6-f914273b3ee7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e069fd75-2fab-42c8-bbb2-8a1bcca01896 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "cinder-quobyte-b3c2c4d2-8591-4154-86a6-f914273b3ee7" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e069fd75-2fab-42c8-bbb2-8a1bcca01896 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-quobyte-b3c2c4d2-8591-4154-86a6-f914273b3ee7" acquired by "delete_volume" :: waited 0.020s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:07 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93d1021-a7ac-4152-8bbe-f90a81a19e13]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e069fd75-2fab-42c8-bbb2-8a1bcca01896 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b3c2c4d2-8591-4154-86a6-f914273b3ee7 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:07 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ba5aa358-95c7-47f3-8e0e-ce3af3cdda29 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.388s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:07 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-ba5aa358-95c7-47f3-8e0e-ce3af3cdda29 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:07 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-ba5aa358-95c7-47f3-8e0e-ce3af3cdda29 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Deleted volume successfully. Sep 28 18:22:07 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ba5aa358-95c7-47f3-8e0e-ce3af3cdda29 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-4b12b748-1086-4225-884a-f139114256fb-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:07 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b3c2c4d2-8591-4154-86a6-f914273b3ee7 Sep 28 18:22:07 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:07 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e069fd75-2fab-42c8-bbb2-8a1bcca01896 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b3c2c4d2-8591-4154-86a6-f914273b3ee7" returned: 0 in 0.576s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e069fd75-2fab-42c8-bbb2-8a1bcca01896 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b3c2c4d2-8591-4154-86a6-f914273b3ee7 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:07 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b3c2c4d2-8591-4154-86a6-f914273b3ee7 Sep 28 18:22:07 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:07 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e069fd75-2fab-42c8-bbb2-8a1bcca01896 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b3c2c4d2-8591-4154-86a6-f914273b3ee7" returned: 0 in 0.338s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:07 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e069fd75-2fab-42c8-bbb2-8a1bcca01896 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-quobyte-b3c2c4d2-8591-4154-86a6-f914273b3ee7" released by "delete_volume" :: held 0.992s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:08 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-e069fd75-2fab-42c8-bbb2-8a1bcca01896 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Created reservations ['2055af62-d2b2-4730-acbd-acb975507484', '4ea396a8-e9a5-4a1b-a690-e2d434f49e66', 'bcdce1e9-5bae-4bb1-a3d6-28d574e3efcc', 'e7609297-c9d7-435a-bd27-d2c8738869ce'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e069fd75-2fab-42c8-bbb2-8a1bcca01896 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e069fd75-2fab-42c8-bbb2-8a1bcca01896 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:08 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e069fd75-2fab-42c8-bbb2-8a1bcca01896 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:08 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e069fd75-2fab-42c8-bbb2-8a1bcca01896 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e069fd75-2fab-42c8-bbb2-8a1bcca01896 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e069fd75-2fab-42c8-bbb2-8a1bcca01896 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:08 devstack sudo[104301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:22:08 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:08 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e069fd75-2fab-42c8-bbb2-8a1bcca01896 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.289s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:08 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-e069fd75-2fab-42c8-bbb2-8a1bcca01896 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:08 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-e069fd75-2fab-42c8-bbb2-8a1bcca01896 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Deleted volume successfully. Sep 28 18:22:08 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e069fd75-2fab-42c8-bbb2-8a1bcca01896 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-b3c2c4d2-8591-4154-86a6-f914273b3ee7-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:09 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-df4f3fe7-4c60-4970-b838-a941039c0520 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "cinder-5a818cdd-e926-46ff-b7e8-3a30e5750b60-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:09 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-df4f3fe7-4c60-4970-b838-a941039c0520 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-5a818cdd-e926-46ff-b7e8-3a30e5750b60-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:09 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-df4f3fe7-4c60-4970-b838-a941039c0520 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "cinder-quobyte-5a818cdd-e926-46ff-b7e8-3a30e5750b60" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:09 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-df4f3fe7-4c60-4970-b838-a941039c0520 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-quobyte-5a818cdd-e926-46ff-b7e8-3a30e5750b60" acquired by "delete_volume" :: waited 0.028s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:09 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcbfcda-f8b7-4feb-ab0a-de636f71a9c6]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-df4f3fe7-4c60-4970-b838-a941039c0520 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a818cdd-e926-46ff-b7e8-3a30e5750b60 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:09 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a818cdd-e926-46ff-b7e8-3a30e5750b60 Sep 28 18:22:09 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:09 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-df4f3fe7-4c60-4970-b838-a941039c0520 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a818cdd-e926-46ff-b7e8-3a30e5750b60" returned: 0 in 0.459s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-df4f3fe7-4c60-4970-b838-a941039c0520 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a818cdd-e926-46ff-b7e8-3a30e5750b60 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:09 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a818cdd-e926-46ff-b7e8-3a30e5750b60 Sep 28 18:22:09 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:10 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-df4f3fe7-4c60-4970-b838-a941039c0520 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5a818cdd-e926-46ff-b7e8-3a30e5750b60" returned: 0 in 0.352s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:10 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-df4f3fe7-4c60-4970-b838-a941039c0520 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-quobyte-5a818cdd-e926-46ff-b7e8-3a30e5750b60" released by "delete_volume" :: held 0.870s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:10 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-df4f3fe7-4c60-4970-b838-a941039c0520 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Created reservations ['cd792165-ceaa-4008-aae7-fd1211c1e163', '22f5420d-27a3-4c26-ba2c-8979dcdc0039', '27d8e5dc-27e3-4ec1-8fe4-620baa642e24', '59f122ff-0d03-4b78-bbc6-20bb583a4d28'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-df4f3fe7-4c60-4970-b838-a941039c0520 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-df4f3fe7-4c60-4970-b838-a941039c0520 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:10 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-df4f3fe7-4c60-4970-b838-a941039c0520 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:10 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-df4f3fe7-4c60-4970-b838-a941039c0520 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-df4f3fe7-4c60-4970-b838-a941039c0520 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-df4f3fe7-4c60-4970-b838-a941039c0520 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:10 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:22:10 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:10 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c253d4a0-34bf-45a7-a327-e817247406eb tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "cinder-44534af0-544f-4a23-b58b-6942e85b0780-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:10 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c253d4a0-34bf-45a7-a327-e817247406eb tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-44534af0-544f-4a23-b58b-6942e85b0780-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:10 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c253d4a0-34bf-45a7-a327-e817247406eb tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "cinder-quobyte-44534af0-544f-4a23-b58b-6942e85b0780" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:10 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c253d4a0-34bf-45a7-a327-e817247406eb tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-quobyte-44534af0-544f-4a23-b58b-6942e85b0780" acquired by "delete_volume" :: waited 0.020s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:10 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[32628828-d468-4737-84f5-816fb3abde11]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c253d4a0-34bf-45a7-a327-e817247406eb tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-44534af0-544f-4a23-b58b-6942e85b0780 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:10 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-df4f3fe7-4c60-4970-b838-a941039c0520 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.363s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:10 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-df4f3fe7-4c60-4970-b838-a941039c0520 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:10 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-df4f3fe7-4c60-4970-b838-a941039c0520 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Deleted volume successfully. Sep 28 18:22:10 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-df4f3fe7-4c60-4970-b838-a941039c0520 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-5a818cdd-e926-46ff-b7e8-3a30e5750b60-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:10 devstack sudo[104314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-44534af0-544f-4a23-b58b-6942e85b0780 Sep 28 18:22:10 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:10 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c253d4a0-34bf-45a7-a327-e817247406eb tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-44534af0-544f-4a23-b58b-6942e85b0780" returned: 0 in 0.415s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c253d4a0-34bf-45a7-a327-e817247406eb tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-44534af0-544f-4a23-b58b-6942e85b0780 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:11 devstack sudo[104320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-44534af0-544f-4a23-b58b-6942e85b0780 Sep 28 18:22:11 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:11 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c253d4a0-34bf-45a7-a327-e817247406eb tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-44534af0-544f-4a23-b58b-6942e85b0780" returned: 0 in 0.299s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:11 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c253d4a0-34bf-45a7-a327-e817247406eb tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-quobyte-44534af0-544f-4a23-b58b-6942e85b0780" released by "delete_volume" :: held 0.782s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:11 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-c253d4a0-34bf-45a7-a327-e817247406eb tempest-CreateVolumesFromSnapshotTest-1272795543 None] Created reservations ['b6ae15e5-8c81-426f-80c2-0ed88648e951', '76758499-f88e-44ff-965a-b087168ccd82', 'b511347d-5d7f-42db-91b0-0bf72064b534', 'e951300c-11ec-427e-a8d9-59b0ea913364'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c253d4a0-34bf-45a7-a327-e817247406eb tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c253d4a0-34bf-45a7-a327-e817247406eb tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:11 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c253d4a0-34bf-45a7-a327-e817247406eb tempest-CreateVolumesFromSnapshotTest-1272795543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:11 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c253d4a0-34bf-45a7-a327-e817247406eb tempest-CreateVolumesFromSnapshotTest-1272795543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c253d4a0-34bf-45a7-a327-e817247406eb tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c253d4a0-34bf-45a7-a327-e817247406eb tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:11 devstack sudo[104324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:22:11 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:11 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ab72551f-3bca-4978-a9b0-58782f421ac7 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "cinder-d7d54930-8b59-4b45-9118-0aaff3c0bca0-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:11 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ab72551f-3bca-4978-a9b0-58782f421ac7 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-d7d54930-8b59-4b45-9118-0aaff3c0bca0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:11 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ab72551f-3bca-4978-a9b0-58782f421ac7 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "cinder-quobyte-88f0bf45-3dcc-483e-9b69-8f692c28f846" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:11 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ab72551f-3bca-4978-a9b0-58782f421ac7 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-quobyte-88f0bf45-3dcc-483e-9b69-8f692c28f846" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:11 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ab72551f-3bca-4978-a9b0-58782f421ac7 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "cinder-quobyte-d7d54930-8b59-4b45-9118-0aaff3c0bca0" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:11 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ab72551f-3bca-4978-a9b0-58782f421ac7 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-quobyte-d7d54930-8b59-4b45-9118-0aaff3c0bca0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:11 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-ab72551f-3bca-4978-a9b0-58782f421ac7 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Deleting offline snapshot d7d54930-8b59-4b45-9118-0aaff3c0bca0 of volume 88f0bf45-3dcc-483e-9b69-8f692c28f846 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:22:11 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:11 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-ab72551f-3bca-4978-a9b0-58782f421ac7 tempest-CreateVolumesFromSnapshotTest-1272795543 None] snapshot_file for this snap is: volume-88f0bf45-3dcc-483e-9b69-8f692c28f846.d7d54930-8b59-4b45-9118-0aaff3c0bca0 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:22:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c253d4a0-34bf-45a7-a327-e817247406eb tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.347s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:11 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-c253d4a0-34bf-45a7-a327-e817247406eb tempest-CreateVolumesFromSnapshotTest-1272795543 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:11 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-c253d4a0-34bf-45a7-a327-e817247406eb tempest-CreateVolumesFromSnapshotTest-1272795543 None] Deleted volume successfully. Sep 28 18:22:11 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f08b4e5-d1ea-46e7-ba96-ad5baffc7eec]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ab72551f-3bca-4978-a9b0-58782f421ac7 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846.d7d54930-8b59-4b45-9118-0aaff3c0bca0 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:11 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-c253d4a0-34bf-45a7-a327-e817247406eb tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-44534af0-544f-4a23-b58b-6942e85b0780-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:11 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846.d7d54930-8b59-4b45-9118-0aaff3c0bca0 Sep 28 18:22:11 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:12 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ab72551f-3bca-4978-a9b0-58782f421ac7 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846.d7d54930-8b59-4b45-9118-0aaff3c0bca0" returned: 0 in 0.487s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:12 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-ab72551f-3bca-4978-a9b0-58782f421ac7 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88f0bf45-3dcc-483e-9b69-8f692c28f846(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:22:12 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef32ee6-db16-4d19-8de9-5e9f6b9efe04]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ab72551f-3bca-4978-a9b0-58782f421ac7 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:12 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846 Sep 28 18:22:12 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:12 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ab72551f-3bca-4978-a9b0-58782f421ac7 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846" returned: 0 in 0.486s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ab72551f-3bca-4978-a9b0-58782f421ac7 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846.d7d54930-8b59-4b45-9118-0aaff3c0bca0 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:12 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846.d7d54930-8b59-4b45-9118-0aaff3c0bca0 Sep 28 18:22:12 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:13 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ab72551f-3bca-4978-a9b0-58782f421ac7 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846.d7d54930-8b59-4b45-9118-0aaff3c0bca0" returned: 0 in 0.499s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ab72551f-3bca-4978-a9b0-58782f421ac7 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846.d7d54930-8b59-4b45-9118-0aaff3c0bca0 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:13 devstack sudo[104342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846.d7d54930-8b59-4b45-9118-0aaff3c0bca0 Sep 28 18:22:13 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:13 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ab72551f-3bca-4978-a9b0-58782f421ac7 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846.d7d54930-8b59-4b45-9118-0aaff3c0bca0" returned: 0 in 0.261s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:13 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ab72551f-3bca-4978-a9b0-58782f421ac7 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-quobyte-d7d54930-8b59-4b45-9118-0aaff3c0bca0" released by "_delete_snapshot" :: held 1.898s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:13 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ab72551f-3bca-4978-a9b0-58782f421ac7 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-quobyte-88f0bf45-3dcc-483e-9b69-8f692c28f846" released by "delete_snapshot" :: held 1.927s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:13 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-ab72551f-3bca-4978-a9b0-58782f421ac7 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Created reservations ['84248dca-0523-4586-ba2f-fccc795896df', 'b8bb8289-4132-435d-9e4a-413aac4f7144', 'd9e5f215-4c90-4de0-b3ed-30ee11e233be', '752dc067-a03d-4d8e-b931-9d1597191295'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:13 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-ab72551f-3bca-4978-a9b0-58782f421ac7 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Delete snapshot completed successfully. Sep 28 18:22:13 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ab72551f-3bca-4978-a9b0-58782f421ac7 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-d7d54930-8b59-4b45-9118-0aaff3c0bca0-delete_snapshot" released by "delete_snapshot" :: held 2.126s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:13 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b152f7d8-e1c9-42ab-ae21-aacbb7bc3d07 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "cinder-88f0bf45-3dcc-483e-9b69-8f692c28f846-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:13 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b152f7d8-e1c9-42ab-ae21-aacbb7bc3d07 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-88f0bf45-3dcc-483e-9b69-8f692c28f846-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:13 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b152f7d8-e1c9-42ab-ae21-aacbb7bc3d07 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "cinder-quobyte-88f0bf45-3dcc-483e-9b69-8f692c28f846" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:22:13 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b152f7d8-e1c9-42ab-ae21-aacbb7bc3d07 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-quobyte-88f0bf45-3dcc-483e-9b69-8f692c28f846" acquired by "delete_volume" :: waited 0.021s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:22:14 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4990f503-b5c5-449e-88a9-581163d2a989]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:22:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b152f7d8-e1c9-42ab-ae21-aacbb7bc3d07 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:14 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846 Sep 28 18:22:14 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:14 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b152f7d8-e1c9-42ab-ae21-aacbb7bc3d07 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846" returned: 0 in 0.457s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b152f7d8-e1c9-42ab-ae21-aacbb7bc3d07 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:14 devstack sudo[104350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846 Sep 28 18:22:14 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:14 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b152f7d8-e1c9-42ab-ae21-aacbb7bc3d07 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-88f0bf45-3dcc-483e-9b69-8f692c28f846" returned: 0 in 0.308s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:14 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b152f7d8-e1c9-42ab-ae21-aacbb7bc3d07 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-quobyte-88f0bf45-3dcc-483e-9b69-8f692c28f846" released by "delete_volume" :: held 0.843s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:14 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-b152f7d8-e1c9-42ab-ae21-aacbb7bc3d07 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Created reservations ['7436f95e-7867-41cb-97ac-0536eaa7559e', '8ad7d2e8-16cc-4d6e-9884-b5a4b038a376', '6b16f11e-1e90-434a-be88-53366c5fcf93', 'bc4d18bb-381c-4d98-ba5e-ca0c1cce676f'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:22:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b152f7d8-e1c9-42ab-ae21-aacbb7bc3d07 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b152f7d8-e1c9-42ab-ae21-aacbb7bc3d07 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:14 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b152f7d8-e1c9-42ab-ae21-aacbb7bc3d07 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:14 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b152f7d8-e1c9-42ab-ae21-aacbb7bc3d07 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b152f7d8-e1c9-42ab-ae21-aacbb7bc3d07 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b152f7d8-e1c9-42ab-ae21-aacbb7bc3d07 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:14 devstack sudo[104353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:22:14 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:15 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b152f7d8-e1c9-42ab-ae21-aacbb7bc3d07 tempest-CreateVolumesFromSnapshotTest-1272795543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.266s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:15 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-b152f7d8-e1c9-42ab-ae21-aacbb7bc3d07 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:22:15 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-b152f7d8-e1c9-42ab-ae21-aacbb7bc3d07 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Deleted volume successfully. Sep 28 18:22:15 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b152f7d8-e1c9-42ab-ae21-aacbb7bc3d07 tempest-CreateVolumesFromSnapshotTest-1272795543 None] Lock "cinder-88f0bf45-3dcc-483e-9b69-8f692c28f846-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:22:24 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=66,cinder:UPDATE=93,cinder:DELETE=7,cinder:INSERT=25 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:22:25 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:INSERT=21,cinder:UPDATE=101,cinder:SELECT=60,cinder:DELETE=9 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:22:28 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:22:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Flow 'volume_create_manager' (30489611-7608-4096-b0ae-59121e6f2d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea27a1ff-84de-4f8d-bed1-cd8d234e545b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea27a1ff-84de-4f8d-bed1-cd8d234e545b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-275551430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acd2bd34-5cfb-4645-9d29-4e47453490fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0eda4880c8450b89598113ff6aabaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:29Z,use_quota=True,user_id='0c91ea0bcae24931bf15395979924bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04335f91-ada0-429d-a0b2-25c82d1bb773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04335f91-ada0-429d-a0b2-25c82d1bb773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60ff6fd3-de0b-45aa-a4e0-9a967c02cba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60ff6fd3-de0b-45aa-a4e0-9a967c02cba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acd2bd34-5cfb-4645-9d29-4e47453490fd', 'volume_name': 'volume-acd2bd34-5cfb-4645-9d29-4e47453490fd', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a370ac8d-411b-4408-a78d-8b32a2df5295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a370ac8d-411b-4408-a78d-8b32a2df5295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71dee118-0008-4989-9f3c-01e36a78b1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:29 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Volume acd2bd34-5cfb-4645-9d29-4e47453490fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acd2bd34-5cfb-4645-9d29-4e47453490fd', 'volume_size': 1} Sep 28 18:22:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-275551430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acd2bd34-5cfb-4645-9d29-4e47453490fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0eda4880c8450b89598113ff6aabaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:22:29Z,use_quota=True,user_id='0c91ea0bcae24931bf15395979924bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:22:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Creating volume acd2bd34-5cfb-4645-9d29-4e47453490fd {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:22:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:22:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:22:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:22:29 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:22:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-acd2bd34-5cfb-4645-9d29-4e47453490fd 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:29 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-acd2bd34-5cfb-4645-9d29-4e47453490fd 1073741824 Sep 28 18:22:29 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:29 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-acd2bd34-5cfb-4645-9d29-4e47453490fd 1073741824" returned: 0 in 0.586s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-acd2bd34-5cfb-4645-9d29-4e47453490fd {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:22:29 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-acd2bd34-5cfb-4645-9d29-4e47453490fd Sep 28 18:22:29 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:22:29 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Sep 28 18:22:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-acd2bd34-5cfb-4645-9d29-4e47453490fd" returned: 0 in 0.319s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:22:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:22:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:30 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71dee118-0008-4989-9f3c-01e36a78b1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acd2bd34-5cfb-4645-9d29-4e47453490fd', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:30 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de493e9b-871c-4137-b452-a499754378cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:22:30 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Volume volume-acd2bd34-5cfb-4645-9d29-4e47453490fd (acd2bd34-5cfb-4645-9d29-4e47453490fd): created successfully Sep 28 18:22:30 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de493e9b-871c-4137-b452-a499754378cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:22:30 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Flow 'volume_create_manager' (30489611-7608-4096-b0ae-59121e6f2d70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:22:30 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-65dd54f9-daea-4d19-a014-53dd69cc7875 tempest-TestMinimumBasicScenario-1126623495 None] Created volume successfully. Sep 28 18:22:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-91891033-b209-435c-857e-163ed2959e67 req-3ab00aa2-28d2-4c1b-8549-a070f987d7e3 tempest-TestMinimumBasicScenario-1126623495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:22:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-91891033-b209-435c-857e-163ed2959e67 req-3ab00aa2-28d2-4c1b-8549-a070f987d7e3 tempest-TestMinimumBasicScenario-1126623495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:22:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-91891033-b209-435c-857e-163ed2959e67 req-3ab00aa2-28d2-4c1b-8549-a070f987d7e3 tempest-TestMinimumBasicScenario-1126623495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:22:32 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-91891033-b209-435c-857e-163ed2959e67 req-3ab00aa2-28d2-4c1b-8549-a070f987d7e3 tempest-TestMinimumBasicScenario-1126623495 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729', 'name': 'volume-acd2bd34-5cfb-4645-9d29-4e47453490fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '51165c45-50a0-4450-9952-911c772bb0d0', 'enforce_multipath': True} {{(pid=86980) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:22:32 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-91891033-b209-435c-857e-163ed2959e67 req-3ab00aa2-28d2-4c1b-8549-a070f987d7e3 tempest-TestMinimumBasicScenario-1126623495 None] attachment_update completed successfully. Sep 28 18:22:42 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=4 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:22:42 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=8,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:23:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:23:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:04 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:23:04 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:04 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.352s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:04 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager._thread_info {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:23:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread count: 28 {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:23:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread info: [<_MainThread(MainThread, started 129097393381504)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:23:23 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-7021a5ea-18f6-418d-b7f6-40aa80d88ddf req-485f01d6-01bb-44bb-b796-9ce948f30a55 tempest-TestMinimumBasicScenario-1126623495 None] Terminate volume connection completed successfully. Sep 28 18:23:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-7021a5ea-18f6-418d-b7f6-40aa80d88ddf req-485f01d6-01bb-44bb-b796-9ce948f30a55 tempest-TestMinimumBasicScenario-1126623495 None] Deleting attachment 51165c45-50a0-4450-9952-911c772bb0d0. {{(pid=86980) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:23:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-69c0adb2-e3bb-4809-a8b4-793a025d71e0 tempest-TestMinimumBasicScenario-1126623495 None] Acquiring lock "cinder-acd2bd34-5cfb-4645-9d29-4e47453490fd-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-69c0adb2-e3bb-4809-a8b4-793a025d71e0 tempest-TestMinimumBasicScenario-1126623495 None] Lock "cinder-acd2bd34-5cfb-4645-9d29-4e47453490fd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-69c0adb2-e3bb-4809-a8b4-793a025d71e0 tempest-TestMinimumBasicScenario-1126623495 None] Acquiring lock "cinder-quobyte-acd2bd34-5cfb-4645-9d29-4e47453490fd" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:23:24 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-69c0adb2-e3bb-4809-a8b4-793a025d71e0 tempest-TestMinimumBasicScenario-1126623495 None] Lock "cinder-quobyte-acd2bd34-5cfb-4645-9d29-4e47453490fd" acquired by "delete_volume" :: waited 0.020s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:23:24 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f545ede3-c010-431f-b18f-caabf76b5334]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:23:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-69c0adb2-e3bb-4809-a8b4-793a025d71e0 tempest-TestMinimumBasicScenario-1126623495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-acd2bd34-5cfb-4645-9d29-4e47453490fd {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:24 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-acd2bd34-5cfb-4645-9d29-4e47453490fd Sep 28 18:23:24 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:24 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-69c0adb2-e3bb-4809-a8b4-793a025d71e0 tempest-TestMinimumBasicScenario-1126623495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-acd2bd34-5cfb-4645-9d29-4e47453490fd" returned: 0 in 0.420s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-69c0adb2-e3bb-4809-a8b4-793a025d71e0 tempest-TestMinimumBasicScenario-1126623495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-acd2bd34-5cfb-4645-9d29-4e47453490fd {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:24 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-acd2bd34-5cfb-4645-9d29-4e47453490fd Sep 28 18:23:24 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:24 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-69c0adb2-e3bb-4809-a8b4-793a025d71e0 tempest-TestMinimumBasicScenario-1126623495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-acd2bd34-5cfb-4645-9d29-4e47453490fd" returned: 0 in 0.258s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:24 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-69c0adb2-e3bb-4809-a8b4-793a025d71e0 tempest-TestMinimumBasicScenario-1126623495 None] Lock "cinder-quobyte-acd2bd34-5cfb-4645-9d29-4e47453490fd" released by "delete_volume" :: held 0.735s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:24 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-69c0adb2-e3bb-4809-a8b4-793a025d71e0 tempest-TestMinimumBasicScenario-1126623495 None] Created reservations ['8c0056cd-c922-44cd-bbc9-60bad258d3e8', '8bb039c6-fb16-4a97-9a7b-7235581e46f9', 'a450159b-9a44-431d-b465-ce0696e3085e', '99e381cf-0308-4ddf-b83b-e604cc716e35'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:23:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-69c0adb2-e3bb-4809-a8b4-793a025d71e0 tempest-TestMinimumBasicScenario-1126623495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:23:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-69c0adb2-e3bb-4809-a8b4-793a025d71e0 tempest-TestMinimumBasicScenario-1126623495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:23:24 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-69c0adb2-e3bb-4809-a8b4-793a025d71e0 tempest-TestMinimumBasicScenario-1126623495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:23:24 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-69c0adb2-e3bb-4809-a8b4-793a025d71e0 tempest-TestMinimumBasicScenario-1126623495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:23:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-69c0adb2-e3bb-4809-a8b4-793a025d71e0 tempest-TestMinimumBasicScenario-1126623495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:23:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-69c0adb2-e3bb-4809-a8b4-793a025d71e0 tempest-TestMinimumBasicScenario-1126623495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:23:24 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:23:24 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:23:25 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Sep 28 18:23:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-69c0adb2-e3bb-4809-a8b4-793a025d71e0 tempest-TestMinimumBasicScenario-1126623495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.284s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:23:25 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-69c0adb2-e3bb-4809-a8b4-793a025d71e0 tempest-TestMinimumBasicScenario-1126623495 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:23:25 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-69c0adb2-e3bb-4809-a8b4-793a025d71e0 tempest-TestMinimumBasicScenario-1126623495 None] Deleted volume successfully. Sep 28 18:23:25 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-69c0adb2-e3bb-4809-a8b4-793a025d71e0 tempest-TestMinimumBasicScenario-1126623495 None] Lock "cinder-acd2bd34-5cfb-4645-9d29-4e47453490fd-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:23:34 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=10 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:23:35 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=7,cinder:UPDATE=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:24:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:24:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:04 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:24:04 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:04 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.322s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:04 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:24:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager._thread_info {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:24:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread count: 28 {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:24:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread info: [<_MainThread(MainThread, started 129097393381504)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:24:07 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:24:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Flow 'volume_create_manager' (3a0e1b16-afba-4fc3-a684-a86f93512ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02644d6a-060e-415e-a3e8-aea8230ac23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02644d6a-060e-415e-a3e8-aea8230ac23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1659675337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d88ec29d-0d0d-44a8-addd-25116b63d832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1977c36e074fe0af77fb90af403d12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:08Z,use_quota=True,user_id='e8854f8b8a0249c689dc4b9d76c4dba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f46bdf0-6600-48b8-a2d3-256dbc67b356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f46bdf0-6600-48b8-a2d3-256dbc67b356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138c1039-c154-41e6-aa2c-8c55fcb61139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:07 devstack cinder-volume[86980]: DEBUG cinder.image.glance [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Creating Keystone auth plugin from conf {{(pid=86980) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:24:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138c1039-c154-41e6-aa2c-8c55fcb61139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd88ec29d-0d0d-44a8-addd-25116b63d832', 'volume_name': 'volume-d88ec29d-0d0d-44a8-addd-25116b63d832', 'volume_size': 1, 'image_id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c13a4cea8f714bb0b9012709acb9372b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'created_at': datetime.datetime(2026, 9, 28, 15, 57, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 57, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f100ba5-ca3c-44b7-b95c-02257f1bb19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f100ba5-ca3c-44b7-b95c-02257f1bb19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:08 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51cec2f-ef0d-41dc-aaf5-dc841a6501e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:08 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Volume d88ec29d-0d0d-44a8-addd-25116b63d832: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d88ec29d-0d0d-44a8-addd-25116b63d832', 'volume_size': 1, 'image_id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c13a4cea8f714bb0b9012709acb9372b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'created_at': datetime.datetime(2026, 9, 28, 15, 57, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 57, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 18:24:08 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Trying to clone d88ec29d-0d0d-44a8-addd-25116b63d832 from image d5838d4d-ebb7-4d18-8c3c-fc660c294083 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}]). {{(pid=86980) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:24:08 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ctafmh08devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:24:08 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Image download 20.69 MB at 20.69 MB/s Sep 28 18:24:08 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ea4975-a651-48c5-875a-71d661cd39cd]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ctafmh08devstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:08 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ctafmh08devstack@QuobyteHD Sep 28 18:24:08 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:09 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ctafmh08devstack@QuobyteHD" returned: 0 in 0.348s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:09 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Temporary image d5838d4d-ebb7-4d18-8c3c-fc660c294083 is fetched for user e8854f8b8a0249c689dc4b9d76c4dba3. {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:24:09 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30ce0e4-a65d-44f4-a9a6-741dc18ce151]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ctafmh08devstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:09 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ctafmh08devstack@QuobyteHD Sep 28 18:24:09 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:09 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ctafmh08devstack@QuobyteHD" returned: 0 in 0.360s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1659675337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d88ec29d-0d0d-44a8-addd-25116b63d832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1977c36e074fe0af77fb90af403d12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:24:08Z,use_quota=True,user_id='e8854f8b8a0249c689dc4b9d76c4dba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:24:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Creating volume d88ec29d-0d0d-44a8-addd-25116b63d832 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:24:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:24:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:24:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:24:09 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:24:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d88ec29d-0d0d-44a8-addd-25116b63d832 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:09 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d88ec29d-0d0d-44a8-addd-25116b63d832 1073741824 Sep 28 18:24:09 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:10 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d88ec29d-0d0d-44a8-addd-25116b63d832 1073741824" returned: 0 in 0.583s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d88ec29d-0d0d-44a8-addd-25116b63d832 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:10 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d88ec29d-0d0d-44a8-addd-25116b63d832 Sep 28 18:24:10 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:10 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d88ec29d-0d0d-44a8-addd-25116b63d832" returned: 0 in 0.323s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:10 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:24:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:10 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Attempting download of d5838d4d-ebb7-4d18-8c3c-fc660c294083 ((None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}])) to volume d88ec29d-0d0d-44a8-addd-25116b63d832. {{(pid=86980) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:24:10 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f9f26b-64b4-476c-acb2-fcf3522bb6f3]: (4, 'raw') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_j_voj_vw {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:10 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_j_voj_vw Sep 28 18:24:10 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:10 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_j_voj_vw" returned: 0 in 0.393s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_j_voj_vw {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:11 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_j_voj_vw Sep 28 18:24:11 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:11 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_j_voj_vw" returned: 1 in 0.382s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5838d4d-ebb7-4d18-8c3c-fc660c294083_j_voj_vw' failed. Not Retrying. {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:24:11 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e81302-2bf9-49d3-9b10-c55abdf2c019]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:24:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ctafmh08devstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:11 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ctafmh08devstack@QuobyteHD Sep 28 18:24:11 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:11 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ctafmh08devstack@QuobyteHD" returned: 0 in 0.419s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:11 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] d5838d4d-ebb7-4d18-8c3c-fc660c294083 was qcow2, converting to qcow2 {{(pid=86980) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:24:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ctafmh08devstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d88ec29d-0d0d-44a8-addd-25116b63d832 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:11 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ctafmh08devstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d88ec29d-0d0d-44a8-addd-25116b63d832 Sep 28 18:24:11 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:13 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ctafmh08devstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d88ec29d-0d0d-44a8-addd-25116b63d832" returned: 0 in 2.035s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:13 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d5838d4d-ebb7-4d18-8c3c-fc660c294083_ctafmh08devstack@QuobyteHD, size 112.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d88ec29d-0d0d-44a8-addd-25116b63d832 {{(pid=86980) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:24:13 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Converted 112.00 MB image at 55.00 MB/s Sep 28 18:24:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d88ec29d-0d0d-44a8-addd-25116b63d832 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:24:13 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d88ec29d-0d0d-44a8-addd-25116b63d832 1G Sep 28 18:24:13 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:24:14 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Sep 28 18:24:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d88ec29d-0d0d-44a8-addd-25116b63d832 1G" returned: 0 in 0.351s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:24:14 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Downloaded image d5838d4d-ebb7-4d18-8c3c-fc660c294083 ((None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}])) to volume d88ec29d-0d0d-44a8-addd-25116b63d832 successfully. {{(pid=86980) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:24:14 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Temporary image d5838d4d-ebb7-4d18-8c3c-fc660c294083 for user e8854f8b8a0249c689dc4b9d76c4dba3 is deleted. {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:24:14 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Marking volume d88ec29d-0d0d-44a8-addd-25116b63d832 as bootable. {{(pid=86980) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:24:14 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Copying metadata from image d5838d4d-ebb7-4d18-8c3c-fc660c294083 to d88ec29d-0d0d-44a8-addd-25116b63d832. {{(pid=86980) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:24:14 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Creating volume glance metadata for volume d88ec29d-0d0d-44a8-addd-25116b63d832 backed by image d5838d4d-ebb7-4d18-8c3c-fc660c294083 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86980) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:24:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51cec2f-ef0d-41dc-aaf5-dc841a6501e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d88ec29d-0d0d-44a8-addd-25116b63d832', 'volume_size': 1, 'image_id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c13a4cea8f714bb0b9012709acb9372b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5838d4d-ebb7-4d18-8c3c-fc660c294083', 'created_at': datetime.datetime(2026, 9, 28, 15, 57, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 57, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5838d4d-ebb7-4d18-8c3c-fc660c294083/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2872f052-794a-482a-8d87-41e1032b85f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:24:14 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Volume volume-d88ec29d-0d0d-44a8-addd-25116b63d832 (d88ec29d-0d0d-44a8-addd-25116b63d832): created successfully Sep 28 18:24:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2872f052-794a-482a-8d87-41e1032b85f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:24:14 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Flow 'volume_create_manager' (3a0e1b16-afba-4fc3-a684-a86f93512ec9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:24:14 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-c13053b0-03b8-473a-a166-33ddd22cd5aa tempest-TestShelveInstance-1460515516 None] Created volume successfully. Sep 28 18:24:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-2994d474-2760-4fd7-b999-bbeb7c39114a req-45284ba9-868f-4587-b479-80e680050a94 tempest-TestShelveInstance-1460515516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:24:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-2994d474-2760-4fd7-b999-bbeb7c39114a req-45284ba9-868f-4587-b479-80e680050a94 tempest-TestShelveInstance-1460515516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:24:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-2994d474-2760-4fd7-b999-bbeb7c39114a req-45284ba9-868f-4587-b479-80e680050a94 tempest-TestShelveInstance-1460515516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:24:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-2994d474-2760-4fd7-b999-bbeb7c39114a req-45284ba9-868f-4587-b479-80e680050a94 tempest-TestShelveInstance-1460515516 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729', 'name': 'volume-d88ec29d-0d0d-44a8-addd-25116b63d832', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '91a4ee06-ec99-4cf7-b9a0-7e87f4f51ee4', 'enforce_multipath': True} {{(pid=86980) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:24:18 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-2994d474-2760-4fd7-b999-bbeb7c39114a req-45284ba9-868f-4587-b479-80e680050a94 tempest-TestShelveInstance-1460515516 None] attachment_update completed successfully. Sep 28 18:24:28 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=15,cinder:UPDATE=6,cinder:INSERT=8 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:24:28 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=18,cinder:UPDATE=7,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:25:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:25:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:04 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:25:04 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:04 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.315s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:04 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager._thread_info {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:25:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread count: 28 {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:25:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread info: [<_MainThread(MainThread, started 129097393381504)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:25:07 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-84298d49-9ac7-4c1d-b123-5e0d7e85ad61 req-9286f72c-a4fe-4e42-81ba-706c996ff70e tempest-TestShelveInstance-1460515516 None] Terminate volume connection completed successfully. Sep 28 18:25:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-84298d49-9ac7-4c1d-b123-5e0d7e85ad61 req-9286f72c-a4fe-4e42-81ba-706c996ff70e tempest-TestShelveInstance-1460515516 None] Deleting attachment 91a4ee06-ec99-4cf7-b9a0-7e87f4f51ee4. {{(pid=86980) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:25:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-f15c4091-5da3-4d4c-ac6f-86364accf589 req-42dc0f14-dbfe-41fe-a9da-a0e6f4d9ccdf tempest-TestShelveInstance-1460515516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-f15c4091-5da3-4d4c-ac6f-86364accf589 req-42dc0f14-dbfe-41fe-a9da-a0e6f4d9ccdf tempest-TestShelveInstance-1460515516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-f15c4091-5da3-4d4c-ac6f-86364accf589 req-42dc0f14-dbfe-41fe-a9da-a0e6f4d9ccdf tempest-TestShelveInstance-1460515516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-f15c4091-5da3-4d4c-ac6f-86364accf589 req-42dc0f14-dbfe-41fe-a9da-a0e6f4d9ccdf tempest-TestShelveInstance-1460515516 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729', 'name': 'volume-d88ec29d-0d0d-44a8-addd-25116b63d832', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6dea411-b971-4ab1-a6bd-93272a400a7b', 'enforce_multipath': True} {{(pid=86980) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 18:25:10 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-f15c4091-5da3-4d4c-ac6f-86364accf589 req-42dc0f14-dbfe-41fe-a9da-a0e6f4d9ccdf tempest-TestShelveInstance-1460515516 None] attachment_update completed successfully. Sep 28 18:25:20 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:25:20 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:25:41 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-6da8f54c-54ce-4509-ac75-54dd78730b6b req-8ad0edb3-f0e6-463d-b31a-11b50950e2d7 tempest-TestShelveInstance-1460515516 None] Terminate volume connection completed successfully. Sep 28 18:25:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [req-6da8f54c-54ce-4509-ac75-54dd78730b6b req-8ad0edb3-f0e6-463d-b31a-11b50950e2d7 tempest-TestShelveInstance-1460515516 None] Deleting attachment d6dea411-b971-4ab1-a6bd-93272a400a7b. {{(pid=86980) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 18:25:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-6da8f54c-54ce-4509-ac75-54dd78730b6b req-ddce5af1-06c3-420b-9125-aaf2f081b582 tempest-TestShelveInstance-1460515516 None] Acquiring lock "cinder-d88ec29d-0d0d-44a8-addd-25116b63d832-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-6da8f54c-54ce-4509-ac75-54dd78730b6b req-ddce5af1-06c3-420b-9125-aaf2f081b582 tempest-TestShelveInstance-1460515516 None] Lock "cinder-d88ec29d-0d0d-44a8-addd-25116b63d832-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-6da8f54c-54ce-4509-ac75-54dd78730b6b req-ddce5af1-06c3-420b-9125-aaf2f081b582 tempest-TestShelveInstance-1460515516 None] Acquiring lock "cinder-quobyte-d88ec29d-0d0d-44a8-addd-25116b63d832" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:25:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-6da8f54c-54ce-4509-ac75-54dd78730b6b req-ddce5af1-06c3-420b-9125-aaf2f081b582 tempest-TestShelveInstance-1460515516 None] Lock "cinder-quobyte-d88ec29d-0d0d-44a8-addd-25116b63d832" acquired by "delete_volume" :: waited 0.018s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:25:42 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[303e7db8-692f-434d-9171-f4f8eb3cffbc]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:25:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-6da8f54c-54ce-4509-ac75-54dd78730b6b req-ddce5af1-06c3-420b-9125-aaf2f081b582 tempest-TestShelveInstance-1460515516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d88ec29d-0d0d-44a8-addd-25116b63d832 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:42 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d88ec29d-0d0d-44a8-addd-25116b63d832 Sep 28 18:25:42 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:42 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-6da8f54c-54ce-4509-ac75-54dd78730b6b req-ddce5af1-06c3-420b-9125-aaf2f081b582 tempest-TestShelveInstance-1460515516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d88ec29d-0d0d-44a8-addd-25116b63d832" returned: 0 in 0.462s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-6da8f54c-54ce-4509-ac75-54dd78730b6b req-ddce5af1-06c3-420b-9125-aaf2f081b582 tempest-TestShelveInstance-1460515516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d88ec29d-0d0d-44a8-addd-25116b63d832 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:42 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d88ec29d-0d0d-44a8-addd-25116b63d832 Sep 28 18:25:42 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:43 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-6da8f54c-54ce-4509-ac75-54dd78730b6b req-ddce5af1-06c3-420b-9125-aaf2f081b582 tempest-TestShelveInstance-1460515516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d88ec29d-0d0d-44a8-addd-25116b63d832" returned: 0 in 0.294s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-6da8f54c-54ce-4509-ac75-54dd78730b6b req-ddce5af1-06c3-420b-9125-aaf2f081b582 tempest-TestShelveInstance-1460515516 None] Lock "cinder-quobyte-d88ec29d-0d0d-44a8-addd-25116b63d832" released by "delete_volume" :: held 0.823s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:43 devstack cinder-volume[86980]: DEBUG cinder.quota [req-6da8f54c-54ce-4509-ac75-54dd78730b6b req-ddce5af1-06c3-420b-9125-aaf2f081b582 tempest-TestShelveInstance-1460515516 None] Created reservations ['040c4dd4-86b1-47b4-a232-82d0945ba5b1', 'ca62d9b5-a26d-41cd-9cb8-5db5691d09c1', '6b351de3-f661-48d7-b59b-423575e6b82e', 'f09be805-e9ad-4aee-bb0c-80e315ab5e08'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:25:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-6da8f54c-54ce-4509-ac75-54dd78730b6b req-ddce5af1-06c3-420b-9125-aaf2f081b582 tempest-TestShelveInstance-1460515516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:25:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-6da8f54c-54ce-4509-ac75-54dd78730b6b req-ddce5af1-06c3-420b-9125-aaf2f081b582 tempest-TestShelveInstance-1460515516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:25:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [req-6da8f54c-54ce-4509-ac75-54dd78730b6b req-ddce5af1-06c3-420b-9125-aaf2f081b582 tempest-TestShelveInstance-1460515516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:25:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [req-6da8f54c-54ce-4509-ac75-54dd78730b6b req-ddce5af1-06c3-420b-9125-aaf2f081b582 tempest-TestShelveInstance-1460515516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:25:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [req-6da8f54c-54ce-4509-ac75-54dd78730b6b req-ddce5af1-06c3-420b-9125-aaf2f081b582 tempest-TestShelveInstance-1460515516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:25:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-6da8f54c-54ce-4509-ac75-54dd78730b6b req-ddce5af1-06c3-420b-9125-aaf2f081b582 tempest-TestShelveInstance-1460515516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:25:43 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:25:43 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:25:43 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Sep 28 18:25:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [req-6da8f54c-54ce-4509-ac75-54dd78730b6b req-ddce5af1-06c3-420b-9125-aaf2f081b582 tempest-TestShelveInstance-1460515516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.296s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:25:43 devstack cinder-volume[86980]: DEBUG cinder.manager [req-6da8f54c-54ce-4509-ac75-54dd78730b6b req-ddce5af1-06c3-420b-9125-aaf2f081b582 tempest-TestShelveInstance-1460515516 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:25:43 devstack cinder-volume[86980]: INFO cinder.volume.manager [req-6da8f54c-54ce-4509-ac75-54dd78730b6b req-ddce5af1-06c3-420b-9125-aaf2f081b582 tempest-TestShelveInstance-1460515516 None] Deleted volume successfully. Sep 28 18:25:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [req-6da8f54c-54ce-4509-ac75-54dd78730b6b req-ddce5af1-06c3-420b-9125-aaf2f081b582 tempest-TestShelveInstance-1460515516 None] Lock "cinder-d88ec29d-0d0d-44a8-addd-25116b63d832-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:25:53 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=1 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:25:53 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:26:00 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Flow 'volume_create_manager' (3735dae9-5e6b-4936-a03d-c60d7d2784b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc76dc7-71ee-40ee-ae96-dda41bc19a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc76dc7-71ee-40ee-ae96-dda41bc19a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dca59c94-3715-4aee-a145-6a7df8083412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94f87016da04f2ea9f9876a4bcf562e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:00Z,use_quota=True,user_id='7d8e892138994bc99fcedf56585f6b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72b1014e-aa03-47fa-a198-02983bab9194),volume_type_id=72b1014e-aa03-47fa-a198-02983bab9194)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7601b02-f18e-4923-997e-195a7394dcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7601b02-f18e-4923-997e-195a7394dcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (975d07f4-cecd-42a9-bb61-e2001abc78d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:00 devstack cinder-volume[86980]: DEBUG cinder.image.glance [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Creating Keystone auth plugin from conf {{(pid=86980) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:26:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (975d07f4-cecd-42a9-bb61-e2001abc78d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dca59c94-3715-4aee-a145-6a7df8083412', 'volume_name': 'volume-dca59c94-3715-4aee-a145-6a7df8083412', 'volume_size': 1, 'image_id': '6b230487-d940-4790-8a30-75e7928c72fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b230487-d940-4790-8a30-75e7928c72fc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd0415babcf0c31c50c4111f50e5dd34a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c94f87016da04f2ea9f9876a4bcf562e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9af0d2f52411a288faf00d03c7af06744e1202dfb020d62508543aea4fe69f2911db19984859799e5c82b4729ac29ba25825de588d867b94f6e1b9b884ab97bb', 'id': '6b230487-d940-4790-8a30-75e7928c72fc', 'created_at': datetime.datetime(2026, 9, 28, 16, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 25, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b230487-d940-4790-8a30-75e7928c72fc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95595545-1d24-4afc-816f-2537730969a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95595545-1d24-4afc-816f-2537730969a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea25c89-c18f-42c5-b77b-780c2df9a606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:00 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Volume dca59c94-3715-4aee-a145-6a7df8083412: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dca59c94-3715-4aee-a145-6a7df8083412', 'volume_size': 1, 'image_id': '6b230487-d940-4790-8a30-75e7928c72fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b230487-d940-4790-8a30-75e7928c72fc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd0415babcf0c31c50c4111f50e5dd34a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c94f87016da04f2ea9f9876a4bcf562e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9af0d2f52411a288faf00d03c7af06744e1202dfb020d62508543aea4fe69f2911db19984859799e5c82b4729ac29ba25825de588d867b94f6e1b9b884ab97bb', 'id': '6b230487-d940-4790-8a30-75e7928c72fc', 'created_at': datetime.datetime(2026, 9, 28, 16, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 25, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b230487-d940-4790-8a30-75e7928c72fc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 18:26:00 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Trying to clone dca59c94-3715-4aee-a145-6a7df8083412 from image 6b230487-d940-4790-8a30-75e7928c72fc at location (None, [{'url': 'file:///opt/stack/data/glance/images/6b230487-d940-4790-8a30-75e7928c72fc', 'metadata': {}}]). {{(pid=86980) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:26:00 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6b230487-d940-4790-8a30-75e7928c72fc_ldwl4orzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:26:00 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Image download 0.00 MB at 0.00 MB/s Sep 28 18:26:00 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26533a5-9794-4434-adb0-0a7f8338271b]: (4, 'raw') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b230487-d940-4790-8a30-75e7928c72fc_ldwl4orzdevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:01 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b230487-d940-4790-8a30-75e7928c72fc_ldwl4orzdevstack@QuobyteHD Sep 28 18:26:01 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:01 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b230487-d940-4790-8a30-75e7928c72fc_ldwl4orzdevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b230487-d940-4790-8a30-75e7928c72fc_ldwl4orzdevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:01 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b230487-d940-4790-8a30-75e7928c72fc_ldwl4orzdevstack@QuobyteHD Sep 28 18:26:01 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:01 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b230487-d940-4790-8a30-75e7928c72fc_ldwl4orzdevstack@QuobyteHD" returned: 1 in 0.374s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b230487-d940-4790-8a30-75e7928c72fc_ldwl4orzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:26:01 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Temporary image 6b230487-d940-4790-8a30-75e7928c72fc is fetched for user 7d8e892138994bc99fcedf56585f6b44. {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:26:01 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6ed4ea-d6db-442e-9991-8b0b51ff00be]: (4, 'raw') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b230487-d940-4790-8a30-75e7928c72fc_ldwl4orzdevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:01 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b230487-d940-4790-8a30-75e7928c72fc_ldwl4orzdevstack@QuobyteHD Sep 28 18:26:01 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:02 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b230487-d940-4790-8a30-75e7928c72fc_ldwl4orzdevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b230487-d940-4790-8a30-75e7928c72fc_ldwl4orzdevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:02 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b230487-d940-4790-8a30-75e7928c72fc_ldwl4orzdevstack@QuobyteHD Sep 28 18:26:02 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:02 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b230487-d940-4790-8a30-75e7928c72fc_ldwl4orzdevstack@QuobyteHD" returned: 1 in 0.406s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b230487-d940-4790-8a30-75e7928c72fc_ldwl4orzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:26:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dca59c94-3715-4aee-a145-6a7df8083412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94f87016da04f2ea9f9876a4bcf562e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:00Z,use_quota=True,user_id='7d8e892138994bc99fcedf56585f6b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72b1014e-aa03-47fa-a198-02983bab9194),volume_type_id=72b1014e-aa03-47fa-a198-02983bab9194)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Creating volume dca59c94-3715-4aee-a145-6a7df8083412 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:02 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:26:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dca59c94-3715-4aee-a145-6a7df8083412 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:02 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dca59c94-3715-4aee-a145-6a7df8083412 1073741824 Sep 28 18:26:02 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:03 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dca59c94-3715-4aee-a145-6a7df8083412 1073741824" returned: 0 in 0.508s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dca59c94-3715-4aee-a145-6a7df8083412 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:03 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dca59c94-3715-4aee-a145-6a7df8083412 Sep 28 18:26:03 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:03 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dca59c94-3715-4aee-a145-6a7df8083412" returned: 0 in 0.265s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:03 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Attempting download of 6b230487-d940-4790-8a30-75e7928c72fc ((None, [{'url': 'file:///opt/stack/data/glance/images/6b230487-d940-4790-8a30-75e7928c72fc', 'metadata': {}}])) to volume dca59c94-3715-4aee-a145-6a7df8083412. {{(pid=86980) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:26:03 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[817822b9-73ae-4da8-beb0-f88352a3bf52]: (4, 'raw') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b230487-d940-4790-8a30-75e7928c72fc_bma5pnt_ {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:03 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b230487-d940-4790-8a30-75e7928c72fc_bma5pnt_ Sep 28 18:26:03 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:03 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b230487-d940-4790-8a30-75e7928c72fc_bma5pnt_" returned: 0 in 0.352s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b230487-d940-4790-8a30-75e7928c72fc_bma5pnt_ {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:03 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b230487-d940-4790-8a30-75e7928c72fc_bma5pnt_ Sep 28 18:26:03 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:04 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b230487-d940-4790-8a30-75e7928c72fc_bma5pnt_" returned: 1 in 0.368s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b230487-d940-4790-8a30-75e7928c72fc_bma5pnt_' failed. Not Retrying. {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:26:04 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[262562cf-b7b2-4252-9aa7-c84cd6b97c91]: (4, 'raw') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b230487-d940-4790-8a30-75e7928c72fc_ldwl4orzdevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:04 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b230487-d940-4790-8a30-75e7928c72fc_ldwl4orzdevstack@QuobyteHD Sep 28 18:26:04 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:26:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:04 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b230487-d940-4790-8a30-75e7928c72fc_ldwl4orzdevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b230487-d940-4790-8a30-75e7928c72fc_ldwl4orzdevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:04 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:26:04 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:04 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b230487-d940-4790-8a30-75e7928c72fc_ldwl4orzdevstack@QuobyteHD Sep 28 18:26:04 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:04 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.271s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:04 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager._thread_info {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:26:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread count: 28 {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:26:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread info: [<_MainThread(MainThread, started 129097393381504)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:26:05 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b230487-d940-4790-8a30-75e7928c72fc_ldwl4orzdevstack@QuobyteHD" returned: 1 in 0.462s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b230487-d940-4790-8a30-75e7928c72fc_ldwl4orzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:26:05 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] 6b230487-d940-4790-8a30-75e7928c72fc was raw, converting to qcow2 {{(pid=86980) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:26:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6b230487-d940-4790-8a30-75e7928c72fc_ldwl4orzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dca59c94-3715-4aee-a145-6a7df8083412 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:05 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6b230487-d940-4790-8a30-75e7928c72fc_ldwl4orzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dca59c94-3715-4aee-a145-6a7df8083412 Sep 28 18:26:05 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:05 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6b230487-d940-4790-8a30-75e7928c72fc_ldwl4orzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dca59c94-3715-4aee-a145-6a7df8083412" returned: 0 in 0.556s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:05 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6b230487-d940-4790-8a30-75e7928c72fc_ldwl4orzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dca59c94-3715-4aee-a145-6a7df8083412 {{(pid=86980) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:26:05 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 18:26:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dca59c94-3715-4aee-a145-6a7df8083412 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:05 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dca59c94-3715-4aee-a145-6a7df8083412 1G Sep 28 18:26:05 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:06 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dca59c94-3715-4aee-a145-6a7df8083412 1G" returned: 0 in 0.354s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:06 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Downloaded image 6b230487-d940-4790-8a30-75e7928c72fc ((None, [{'url': 'file:///opt/stack/data/glance/images/6b230487-d940-4790-8a30-75e7928c72fc', 'metadata': {}}])) to volume dca59c94-3715-4aee-a145-6a7df8083412 successfully. {{(pid=86980) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:26:06 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Temporary image 6b230487-d940-4790-8a30-75e7928c72fc for user 7d8e892138994bc99fcedf56585f6b44 is deleted. {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:26:06 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Marking volume dca59c94-3715-4aee-a145-6a7df8083412 as bootable. {{(pid=86980) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:26:06 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Copying metadata from image 6b230487-d940-4790-8a30-75e7928c72fc to dca59c94-3715-4aee-a145-6a7df8083412. {{(pid=86980) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:26:06 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Creating volume glance metadata for volume dca59c94-3715-4aee-a145-6a7df8083412 backed by image 6b230487-d940-4790-8a30-75e7928c72fc with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6b230487-d940-4790-8a30-75e7928c72fc', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd0415babcf0c31c50c4111f50e5dd34a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86980) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:26:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea25c89-c18f-42c5-b77b-780c2df9a606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dca59c94-3715-4aee-a145-6a7df8083412', 'volume_size': 1, 'image_id': '6b230487-d940-4790-8a30-75e7928c72fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b230487-d940-4790-8a30-75e7928c72fc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd0415babcf0c31c50c4111f50e5dd34a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c94f87016da04f2ea9f9876a4bcf562e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9af0d2f52411a288faf00d03c7af06744e1202dfb020d62508543aea4fe69f2911db19984859799e5c82b4729ac29ba25825de588d867b94f6e1b9b884ab97bb', 'id': '6b230487-d940-4790-8a30-75e7928c72fc', 'created_at': datetime.datetime(2026, 9, 28, 16, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 25, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b230487-d940-4790-8a30-75e7928c72fc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (461fa11e-1070-4cb2-84fc-4021d6a5a135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:06 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Volume volume-dca59c94-3715-4aee-a145-6a7df8083412 (dca59c94-3715-4aee-a145-6a7df8083412): created successfully Sep 28 18:26:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (461fa11e-1070-4cb2-84fc-4021d6a5a135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Flow 'volume_create_manager' (3735dae9-5e6b-4936-a03d-c60d7d2784b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:06 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-619098e0-d24a-4759-9fd6-e2cb98b71978 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Created volume successfully. Sep 28 18:26:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-2557d810-5ca9-49bd-a92c-ca511610c0a6 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Acquiring lock "cinder-dca59c94-3715-4aee-a145-6a7df8083412-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-2557d810-5ca9-49bd-a92c-ca511610c0a6 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Lock "cinder-dca59c94-3715-4aee-a145-6a7df8083412-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-2557d810-5ca9-49bd-a92c-ca511610c0a6 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Acquiring lock "cinder-quobyte-dca59c94-3715-4aee-a145-6a7df8083412" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-2557d810-5ca9-49bd-a92c-ca511610c0a6 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Lock "cinder-quobyte-dca59c94-3715-4aee-a145-6a7df8083412" acquired by "delete_volume" :: waited 0.020s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:06 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d3a84a-d4a2-494e-a3a1-3414d3c7d407]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2557d810-5ca9-49bd-a92c-ca511610c0a6 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dca59c94-3715-4aee-a145-6a7df8083412 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:07 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dca59c94-3715-4aee-a145-6a7df8083412 Sep 28 18:26:07 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:07 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2557d810-5ca9-49bd-a92c-ca511610c0a6 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dca59c94-3715-4aee-a145-6a7df8083412" returned: 0 in 0.439s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2557d810-5ca9-49bd-a92c-ca511610c0a6 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dca59c94-3715-4aee-a145-6a7df8083412 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:07 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dca59c94-3715-4aee-a145-6a7df8083412 Sep 28 18:26:07 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:07 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2557d810-5ca9-49bd-a92c-ca511610c0a6 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-dca59c94-3715-4aee-a145-6a7df8083412" returned: 0 in 0.294s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:07 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-2557d810-5ca9-49bd-a92c-ca511610c0a6 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Lock "cinder-quobyte-dca59c94-3715-4aee-a145-6a7df8083412" released by "delete_volume" :: held 0.787s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:07 devstack cinder-volume[86980]: WARNING cinder.quota [None req-2557d810-5ca9-49bd-a92c-ca511610c0a6 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:26:07 devstack cinder-volume[86980]: WARNING cinder.quota [None req-2557d810-5ca9-49bd-a92c-ca511610c0a6 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 18:26:07 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-2557d810-5ca9-49bd-a92c-ca511610c0a6 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Created reservations ['3d820789-2acd-4a52-9c35-dca45ebbdf20', 'c84fd2fc-dd14-45d1-8270-2a7c64e0b7ba', 'b8b02d01-5638-4e4f-a984-67529faa4292', '887645c1-b842-40c1-921c-8da745c6de50'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2557d810-5ca9-49bd-a92c-ca511610c0a6 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2557d810-5ca9-49bd-a92c-ca511610c0a6 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2557d810-5ca9-49bd-a92c-ca511610c0a6 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2557d810-5ca9-49bd-a92c-ca511610c0a6 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2557d810-5ca9-49bd-a92c-ca511610c0a6 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2557d810-5ca9-49bd-a92c-ca511610c0a6 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:07 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:26:07 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:08 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2557d810-5ca9-49bd-a92c-ca511610c0a6 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.340s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:08 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-2557d810-5ca9-49bd-a92c-ca511610c0a6 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:08 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-2557d810-5ca9-49bd-a92c-ca511610c0a6 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Deleted volume successfully. Sep 28 18:26:08 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-2557d810-5ca9-49bd-a92c-ca511610c0a6 tempest-VolumeAndVolumeTypeFromImageTest-2146769805 None] Lock "cinder-dca59c94-3715-4aee-a145-6a7df8083412-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:15 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Flow 'volume_create_manager' (6992adef-d0b6-49d7-98dc-8937e8e66b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b86fdf7-3115-4425-a838-4bd5014d7873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b86fdf7-3115-4425-a838-4bd5014d7873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=018242f2-7251-43d7-9f45-4dd67f5d9c7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d8c446f0543461d891d627e5a19226e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:16Z,use_quota=True,user_id='390b6ee097314060bc111312eecc0d99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (071ef4d8-e78e-4b4f-9a1c-833c0346f6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (071ef4d8-e78e-4b4f-9a1c-833c0346f6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c7228b1-2fcc-4f93-8d0b-1358c4104e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:15 devstack cinder-volume[86980]: DEBUG cinder.image.glance [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Creating Keystone auth plugin from conf {{(pid=86980) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:26:15 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c7228b1-2fcc-4f93-8d0b-1358c4104e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '018242f2-7251-43d7-9f45-4dd67f5d9c7e', 'volume_name': 'volume-018242f2-7251-43d7-9f45-4dd67f5d9c7e', 'volume_size': 1, 'image_id': 'e8bc035f-4971-4826-bd72-24ce9c4ff4cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e8bc035f-4971-4826-bd72-24ce9c4ff4cd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b685cfa6fbc044cb71bf99e2f8dd33a4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8d8c446f0543461d891d627e5a19226e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '125b96ce0ac49d1d205acba10ee1a29dfd2ccbf5a983a60fbe95ba6d0277b77079f500e633de35b17bccd2769abf341eed37f3a7f45041cc686e5b85151cb834', 'id': 'e8bc035f-4971-4826-bd72-24ce9c4ff4cd', 'created_at': datetime.datetime(2026, 9, 28, 16, 26, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 26, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e8bc035f-4971-4826-bd72-24ce9c4ff4cd/file', 'properties': {}}, 'image_service': }' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8bc5dde-6506-4740-8087-e7a182fcd438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8bc5dde-6506-4740-8087-e7a182fcd438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58350a3e-bd83-4224-a267-e6c875decb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:16 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Volume 018242f2-7251-43d7-9f45-4dd67f5d9c7e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-018242f2-7251-43d7-9f45-4dd67f5d9c7e', 'volume_size': 1, 'image_id': 'e8bc035f-4971-4826-bd72-24ce9c4ff4cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e8bc035f-4971-4826-bd72-24ce9c4ff4cd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b685cfa6fbc044cb71bf99e2f8dd33a4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8d8c446f0543461d891d627e5a19226e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '125b96ce0ac49d1d205acba10ee1a29dfd2ccbf5a983a60fbe95ba6d0277b77079f500e633de35b17bccd2769abf341eed37f3a7f45041cc686e5b85151cb834', 'id': 'e8bc035f-4971-4826-bd72-24ce9c4ff4cd', 'created_at': datetime.datetime(2026, 9, 28, 16, 26, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 26, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e8bc035f-4971-4826-bd72-24ce9c4ff4cd/file', 'properties': {}}, 'image_service': } Sep 28 18:26:16 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Trying to clone 018242f2-7251-43d7-9f45-4dd67f5d9c7e from image e8bc035f-4971-4826-bd72-24ce9c4ff4cd at location (None, [{'url': 'file:///opt/stack/data/glance/images/e8bc035f-4971-4826-bd72-24ce9c4ff4cd', 'metadata': {}}]). {{(pid=86980) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:26:16 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_4judvbobdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:26:16 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Image download 0.00 MB at 0.00 MB/s Sep 28 18:26:16 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4c1f74-9f28-4d55-90e6-74d792a4fc6b]: (4, 'raw') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_4judvbobdevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:16 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_4judvbobdevstack@QuobyteHD Sep 28 18:26:16 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:16 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_4judvbobdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_4judvbobdevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:16 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_4judvbobdevstack@QuobyteHD Sep 28 18:26:16 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:16 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_4judvbobdevstack@QuobyteHD" returned: 1 in 0.451s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_4judvbobdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:26:16 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Temporary image e8bc035f-4971-4826-bd72-24ce9c4ff4cd is fetched for user 390b6ee097314060bc111312eecc0d99. {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:26:17 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8697535c-8c36-4598-8656-4855f8f595d9]: (4, 'raw') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_4judvbobdevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:17 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_4judvbobdevstack@QuobyteHD Sep 28 18:26:17 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:17 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_4judvbobdevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_4judvbobdevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:17 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_4judvbobdevstack@QuobyteHD Sep 28 18:26:17 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:17 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_4judvbobdevstack@QuobyteHD" returned: 1 in 0.366s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_4judvbobdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:26:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:17 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=018242f2-7251-43d7-9f45-4dd67f5d9c7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d8c446f0543461d891d627e5a19226e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:16Z,use_quota=True,user_id='390b6ee097314060bc111312eecc0d99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:17 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Creating volume 018242f2-7251-43d7-9f45-4dd67f5d9c7e {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:17 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:17 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:17 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:17 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:26:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-018242f2-7251-43d7-9f45-4dd67f5d9c7e 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:17 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-018242f2-7251-43d7-9f45-4dd67f5d9c7e 1073741824 Sep 28 18:26:17 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:18 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-018242f2-7251-43d7-9f45-4dd67f5d9c7e 1073741824" returned: 0 in 0.460s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-018242f2-7251-43d7-9f45-4dd67f5d9c7e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:18 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-018242f2-7251-43d7-9f45-4dd67f5d9c7e Sep 28 18:26:18 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:18 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-018242f2-7251-43d7-9f45-4dd67f5d9c7e" returned: 0 in 0.271s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:18 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Attempting download of e8bc035f-4971-4826-bd72-24ce9c4ff4cd ((None, [{'url': 'file:///opt/stack/data/glance/images/e8bc035f-4971-4826-bd72-24ce9c4ff4cd', 'metadata': {}}])) to volume 018242f2-7251-43d7-9f45-4dd67f5d9c7e. {{(pid=86980) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:26:18 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08417e3-d8a2-44f2-be64-b4d67c62069f]: (4, 'raw') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_olufe0e6 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:18 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_olufe0e6 Sep 28 18:26:18 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:19 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_olufe0e6" returned: 0 in 0.355s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_olufe0e6 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:19 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_olufe0e6 Sep 28 18:26:19 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:19 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_olufe0e6" returned: 1 in 0.344s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_olufe0e6' failed. Not Retrying. {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:26:19 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[70321a43-d34c-4ea9-b6bb-06436002293b]: (4, 'raw') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_4judvbobdevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:19 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_4judvbobdevstack@QuobyteHD Sep 28 18:26:19 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:19 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_4judvbobdevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_4judvbobdevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:19 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_4judvbobdevstack@QuobyteHD Sep 28 18:26:19 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:20 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_4judvbobdevstack@QuobyteHD" returned: 1 in 0.402s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_4judvbobdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:26:20 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] e8bc035f-4971-4826-bd72-24ce9c4ff4cd was raw, converting to qcow2 {{(pid=86980) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:26:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_4judvbobdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-018242f2-7251-43d7-9f45-4dd67f5d9c7e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:20 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_4judvbobdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-018242f2-7251-43d7-9f45-4dd67f5d9c7e Sep 28 18:26:20 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:20 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_4judvbobdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-018242f2-7251-43d7-9f45-4dd67f5d9c7e" returned: 0 in 0.495s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:20 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e8bc035f-4971-4826-bd72-24ce9c4ff4cd_4judvbobdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-018242f2-7251-43d7-9f45-4dd67f5d9c7e {{(pid=86980) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:26:20 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 18:26:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-018242f2-7251-43d7-9f45-4dd67f5d9c7e 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:20 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-018242f2-7251-43d7-9f45-4dd67f5d9c7e 1G Sep 28 18:26:20 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:20 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-018242f2-7251-43d7-9f45-4dd67f5d9c7e 1G" returned: 0 in 0.364s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:20 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Downloaded image e8bc035f-4971-4826-bd72-24ce9c4ff4cd ((None, [{'url': 'file:///opt/stack/data/glance/images/e8bc035f-4971-4826-bd72-24ce9c4ff4cd', 'metadata': {}}])) to volume 018242f2-7251-43d7-9f45-4dd67f5d9c7e successfully. {{(pid=86980) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:26:21 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Temporary image e8bc035f-4971-4826-bd72-24ce9c4ff4cd for user 390b6ee097314060bc111312eecc0d99 is deleted. {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:26:21 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Marking volume 018242f2-7251-43d7-9f45-4dd67f5d9c7e as bootable. {{(pid=86980) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:26:21 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Copying metadata from image e8bc035f-4971-4826-bd72-24ce9c4ff4cd to 018242f2-7251-43d7-9f45-4dd67f5d9c7e. {{(pid=86980) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:26:21 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Creating volume glance metadata for volume 018242f2-7251-43d7-9f45-4dd67f5d9c7e backed by image e8bc035f-4971-4826-bd72-24ce9c4ff4cd with: {'image_id': 'e8bc035f-4971-4826-bd72-24ce9c4ff4cd', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b685cfa6fbc044cb71bf99e2f8dd33a4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86980) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:26:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58350a3e-bd83-4224-a267-e6c875decb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-018242f2-7251-43d7-9f45-4dd67f5d9c7e', 'volume_size': 1, 'image_id': 'e8bc035f-4971-4826-bd72-24ce9c4ff4cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e8bc035f-4971-4826-bd72-24ce9c4ff4cd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b685cfa6fbc044cb71bf99e2f8dd33a4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8d8c446f0543461d891d627e5a19226e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '125b96ce0ac49d1d205acba10ee1a29dfd2ccbf5a983a60fbe95ba6d0277b77079f500e633de35b17bccd2769abf341eed37f3a7f45041cc686e5b85151cb834', 'id': 'e8bc035f-4971-4826-bd72-24ce9c4ff4cd', 'created_at': datetime.datetime(2026, 9, 28, 16, 26, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 26, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e8bc035f-4971-4826-bd72-24ce9c4ff4cd/file', 'properties': {}}, 'image_service': }' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b19f6d5-622c-4f88-881f-07257ffe9562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:21 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Volume volume-018242f2-7251-43d7-9f45-4dd67f5d9c7e (018242f2-7251-43d7-9f45-4dd67f5d9c7e): created successfully Sep 28 18:26:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b19f6d5-622c-4f88-881f-07257ffe9562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Flow 'volume_create_manager' (6992adef-d0b6-49d7-98dc-8937e8e66b72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:21 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-7dcc3cd8-43d2-484d-bd59-e84b1758cd88 tempest-VolumeImageDependencyTests-704779948 None] Created volume successfully. Sep 28 18:26:22 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3a062e42-f6a1-41a9-b7c2-6ebece2f6082 tempest-VolumeImageDependencyTests-704779948 None] Acquiring lock "cinder-018242f2-7251-43d7-9f45-4dd67f5d9c7e-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:22 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3a062e42-f6a1-41a9-b7c2-6ebece2f6082 tempest-VolumeImageDependencyTests-704779948 None] Lock "cinder-018242f2-7251-43d7-9f45-4dd67f5d9c7e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:22 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3a062e42-f6a1-41a9-b7c2-6ebece2f6082 tempest-VolumeImageDependencyTests-704779948 None] Acquiring lock "cinder-quobyte-018242f2-7251-43d7-9f45-4dd67f5d9c7e" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:22 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3a062e42-f6a1-41a9-b7c2-6ebece2f6082 tempest-VolumeImageDependencyTests-704779948 None] Lock "cinder-quobyte-018242f2-7251-43d7-9f45-4dd67f5d9c7e" acquired by "delete_volume" :: waited 0.018s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:22 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[793c824e-75cb-4df5-9fb0-a0ac16f3e8a9]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3a062e42-f6a1-41a9-b7c2-6ebece2f6082 tempest-VolumeImageDependencyTests-704779948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-018242f2-7251-43d7-9f45-4dd67f5d9c7e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:22 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-018242f2-7251-43d7-9f45-4dd67f5d9c7e Sep 28 18:26:22 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:22 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3a062e42-f6a1-41a9-b7c2-6ebece2f6082 tempest-VolumeImageDependencyTests-704779948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-018242f2-7251-43d7-9f45-4dd67f5d9c7e" returned: 0 in 0.456s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3a062e42-f6a1-41a9-b7c2-6ebece2f6082 tempest-VolumeImageDependencyTests-704779948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-018242f2-7251-43d7-9f45-4dd67f5d9c7e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:22 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-018242f2-7251-43d7-9f45-4dd67f5d9c7e Sep 28 18:26:22 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:23 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3a062e42-f6a1-41a9-b7c2-6ebece2f6082 tempest-VolumeImageDependencyTests-704779948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-018242f2-7251-43d7-9f45-4dd67f5d9c7e" returned: 0 in 0.320s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3a062e42-f6a1-41a9-b7c2-6ebece2f6082 tempest-VolumeImageDependencyTests-704779948 None] Lock "cinder-quobyte-018242f2-7251-43d7-9f45-4dd67f5d9c7e" released by "delete_volume" :: held 0.828s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:23 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-3a062e42-f6a1-41a9-b7c2-6ebece2f6082 tempest-VolumeImageDependencyTests-704779948 None] Created reservations ['eb819485-a652-4d16-b694-a4a135f19cbc', '823cee8b-d122-45a5-8ed5-17b95bdaddf8', 'c6b67ea9-87a1-4d1b-bb61-e570ad67e5cd', 'adfac105-740d-4369-b806-e3aa81c25bdf'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3a062e42-f6a1-41a9-b7c2-6ebece2f6082 tempest-VolumeImageDependencyTests-704779948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3a062e42-f6a1-41a9-b7c2-6ebece2f6082 tempest-VolumeImageDependencyTests-704779948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3a062e42-f6a1-41a9-b7c2-6ebece2f6082 tempest-VolumeImageDependencyTests-704779948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3a062e42-f6a1-41a9-b7c2-6ebece2f6082 tempest-VolumeImageDependencyTests-704779948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3a062e42-f6a1-41a9-b7c2-6ebece2f6082 tempest-VolumeImageDependencyTests-704779948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3a062e42-f6a1-41a9-b7c2-6ebece2f6082 tempest-VolumeImageDependencyTests-704779948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:23 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:26:23 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:23 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3a062e42-f6a1-41a9-b7c2-6ebece2f6082 tempest-VolumeImageDependencyTests-704779948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.367s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:23 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-3a062e42-f6a1-41a9-b7c2-6ebece2f6082 tempest-VolumeImageDependencyTests-704779948 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:23 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-3a062e42-f6a1-41a9-b7c2-6ebece2f6082 tempest-VolumeImageDependencyTests-704779948 None] Deleted volume successfully. Sep 28 18:26:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3a062e42-f6a1-41a9-b7c2-6ebece2f6082 tempest-VolumeImageDependencyTests-704779948 None] Lock "cinder-018242f2-7251-43d7-9f45-4dd67f5d9c7e-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:27 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:27 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Flow 'volume_create_manager' (6336b301-ba87-4b22-9966-0686cf3af32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:27 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d0ccc26-b9c3-40e6-a074-2a5a1c6bf8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:27 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d0ccc26-b9c3-40e6-a074-2a5a1c6bf8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2b9d17-4165-4195-9f5c-375824b8e57b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a2e8a416b9940b2b2138eb11b9440a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:27Z,use_quota=True,user_id='8d08c2a983094f6fa431874b484bad39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:27 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e18b1a8b-7510-4a11-97de-ad9fc986b3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:27 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e18b1a8b-7510-4a11-97de-ad9fc986b3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:27 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73aa1b96-24eb-4ef9-8853-4f0e66e11ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:27 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73aa1b96-24eb-4ef9-8853-4f0e66e11ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa2b9d17-4165-4195-9f5c-375824b8e57b', 'volume_name': 'volume-fa2b9d17-4165-4195-9f5c-375824b8e57b', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:27 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aeeea37-3353-4840-988f-67244bdfb22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:27 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aeeea37-3353-4840-988f-67244bdfb22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:27 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6cbb624-a51f-4d1c-b4a3-f32e0f579369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:27 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Volume fa2b9d17-4165-4195-9f5c-375824b8e57b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa2b9d17-4165-4195-9f5c-375824b8e57b', 'volume_size': 1} Sep 28 18:26:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2b9d17-4165-4195-9f5c-375824b8e57b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a2e8a416b9940b2b2138eb11b9440a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:27Z,use_quota=True,user_id='8d08c2a983094f6fa431874b484bad39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Creating volume fa2b9d17-4165-4195-9f5c-375824b8e57b {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:27 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:26:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa2b9d17-4165-4195-9f5c-375824b8e57b 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:27 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa2b9d17-4165-4195-9f5c-375824b8e57b 1073741824 Sep 28 18:26:27 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:27 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa2b9d17-4165-4195-9f5c-375824b8e57b 1073741824" returned: 0 in 0.512s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa2b9d17-4165-4195-9f5c-375824b8e57b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:27 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa2b9d17-4165-4195-9f5c-375824b8e57b Sep 28 18:26:27 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:28 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa2b9d17-4165-4195-9f5c-375824b8e57b" returned: 0 in 0.278s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:28 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6cbb624-a51f-4d1c-b4a3-f32e0f579369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa2b9d17-4165-4195-9f5c-375824b8e57b', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (825b11a3-3592-4fdc-9eb2-f43f92083ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:28 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Volume volume-fa2b9d17-4165-4195-9f5c-375824b8e57b (fa2b9d17-4165-4195-9f5c-375824b8e57b): created successfully Sep 28 18:26:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (825b11a3-3592-4fdc-9eb2-f43f92083ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Flow 'volume_create_manager' (6336b301-ba87-4b22-9966-0686cf3af32b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:28 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-73c0a59d-077b-410d-9d4a-0953185d3ee6 tempest-CinderUnicodeTest-1757593613 None] Created volume successfully. Sep 28 18:26:29 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Flow 'volume_create_manager' (cccc8cb9-845a-425a-bcf4-905bf8e551e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aefdc68e-e387-4aa8-8c39-b6c6f6a7a87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aefdc68e-e387-4aa8-8c39-b6c6f6a7a87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-962838543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=658d1365-2d4f-4fbe-acc5-c956d9710ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a2e8a416b9940b2b2138eb11b9440a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:30Z,use_quota=True,user_id='8d08c2a983094f6fa431874b484bad39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aee9c8f-f3d3-4ba8-8847-a4e7d59303b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aee9c8f-f3d3-4ba8-8847-a4e7d59303b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (121ee31d-0626-4da7-987b-23495b8c8f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (121ee31d-0626-4da7-987b-23495b8c8f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '658d1365-2d4f-4fbe-acc5-c956d9710ef2', 'volume_name': 'volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0bad2e6-a7ec-4a9b-96fa-bf5792902abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0bad2e6-a7ec-4a9b-96fa-bf5792902abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de2780c-1d3f-4487-ba05-794942f326f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:29 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Volume 658d1365-2d4f-4fbe-acc5-c956d9710ef2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2', 'volume_size': 1} Sep 28 18:26:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-962838543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=658d1365-2d4f-4fbe-acc5-c956d9710ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a2e8a416b9940b2b2138eb11b9440a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:30Z,use_quota=True,user_id='8d08c2a983094f6fa431874b484bad39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Creating volume 658d1365-2d4f-4fbe-acc5-c956d9710ef2 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:29 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:26:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:29 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2 1073741824 Sep 28 18:26:29 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:30 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2 1073741824" returned: 0 in 0.457s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:30 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2 Sep 28 18:26:30 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:30 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2" returned: 0 in 0.270s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:30 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:30 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de2780c-1d3f-4487-ba05-794942f326f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:30 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55e3bbd-c992-44bd-9caf-4439d9a71462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:30 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Volume volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2 (658d1365-2d4f-4fbe-acc5-c956d9710ef2): created successfully Sep 28 18:26:30 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55e3bbd-c992-44bd-9caf-4439d9a71462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:30 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Flow 'volume_create_manager' (cccc8cb9-845a-425a-bcf4-905bf8e551e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:30 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-2494e67e-ff12-4072-8473-537ba4377fdd tempest-CinderUnicodeTest-1757593613 None] Created volume successfully. Sep 28 18:26:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4bd76667-0f00-4eb1-a8e6-ccd8e4d05b41 tempest-CinderUnicodeTest-1757593613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4bd76667-0f00-4eb1-a8e6-ccd8e4d05b41 tempest-CinderUnicodeTest-1757593613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:32 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-4bd76667-0f00-4eb1-a8e6-ccd8e4d05b41 tempest-CinderUnicodeTest-1757593613 None] Creating offline snapshot 0a2a866b-aa1b-422b-bd14-6a92b406a1f6 of volume 658d1365-2d4f-4fbe-acc5-c956d9710ef2 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:26:32 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce87fc07-a50d-4773-aaf6-153563624e6c]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4bd76667-0f00-4eb1-a8e6-ccd8e4d05b41 tempest-CinderUnicodeTest-1757593613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:32 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2 Sep 28 18:26:32 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:32 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4bd76667-0f00-4eb1-a8e6-ccd8e4d05b41 tempest-CinderUnicodeTest-1757593613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2" returned: 0 in 0.390s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4bd76667-0f00-4eb1-a8e6-ccd8e4d05b41 tempest-CinderUnicodeTest-1757593613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2.0a2a866b-aa1b-422b-bd14-6a92b406a1f6 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:32 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2.0a2a866b-aa1b-422b-bd14-6a92b406a1f6 1G Sep 28 18:26:32 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:33 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4bd76667-0f00-4eb1-a8e6-ccd8e4d05b41 tempest-CinderUnicodeTest-1757593613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2.0a2a866b-aa1b-422b-bd14-6a92b406a1f6 1G" returned: 0 in 0.447s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4bd76667-0f00-4eb1-a8e6-ccd8e4d05b41 tempest-CinderUnicodeTest-1757593613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2.0a2a866b-aa1b-422b-bd14-6a92b406a1f6 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:33 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2.0a2a866b-aa1b-422b-bd14-6a92b406a1f6 Sep 28 18:26:33 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:33 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4bd76667-0f00-4eb1-a8e6-ccd8e4d05b41 tempest-CinderUnicodeTest-1757593613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2.0a2a866b-aa1b-422b-bd14-6a92b406a1f6" returned: 0 in 0.325s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:33 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-4bd76667-0f00-4eb1-a8e6-ccd8e4d05b41 tempest-CinderUnicodeTest-1757593613 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2.0a2a866b-aa1b-422b-bd14-6a92b406a1f6 is being set with open permissions: ugo+rw Sep 28 18:26:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4bd76667-0f00-4eb1-a8e6-ccd8e4d05b41 tempest-CinderUnicodeTest-1757593613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2.0a2a866b-aa1b-422b-bd14-6a92b406a1f6 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:33 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2.0a2a866b-aa1b-422b-bd14-6a92b406a1f6 Sep 28 18:26:33 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:33 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4bd76667-0f00-4eb1-a8e6-ccd8e4d05b41 tempest-CinderUnicodeTest-1757593613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2.0a2a866b-aa1b-422b-bd14-6a92b406a1f6" returned: 0 in 0.278s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4bd76667-0f00-4eb1-a8e6-ccd8e4d05b41 tempest-CinderUnicodeTest-1757593613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:33 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2.info Sep 28 18:26:33 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:34 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4bd76667-0f00-4eb1-a8e6-ccd8e4d05b41 tempest-CinderUnicodeTest-1757593613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2.info" returned: 0 in 0.253s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:34 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-4bd76667-0f00-4eb1-a8e6-ccd8e4d05b41 tempest-CinderUnicodeTest-1757593613 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2.info is being set with open permissions: ugo+rw Sep 28 18:26:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4bd76667-0f00-4eb1-a8e6-ccd8e4d05b41 tempest-CinderUnicodeTest-1757593613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:34 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2.info Sep 28 18:26:34 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:34 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4bd76667-0f00-4eb1-a8e6-ccd8e4d05b41 tempest-CinderUnicodeTest-1757593613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2.info" returned: 0 in 0.258s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4bd76667-0f00-4eb1-a8e6-ccd8e4d05b41 tempest-CinderUnicodeTest-1757593613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.074s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:34 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-4bd76667-0f00-4eb1-a8e6-ccd8e4d05b41 tempest-CinderUnicodeTest-1757593613 None] Create snapshot completed successfully Sep 28 18:26:35 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9b99027e-e72e-4e02-a95b-6159a94c2cfa tempest-CinderUnicodeTest-1757593613 None] Acquiring lock "cinder-0a2a866b-aa1b-422b-bd14-6a92b406a1f6-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:35 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9b99027e-e72e-4e02-a95b-6159a94c2cfa tempest-CinderUnicodeTest-1757593613 None] Lock "cinder-0a2a866b-aa1b-422b-bd14-6a92b406a1f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:35 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9b99027e-e72e-4e02-a95b-6159a94c2cfa tempest-CinderUnicodeTest-1757593613 None] Acquiring lock "cinder-quobyte-658d1365-2d4f-4fbe-acc5-c956d9710ef2" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:35 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9b99027e-e72e-4e02-a95b-6159a94c2cfa tempest-CinderUnicodeTest-1757593613 None] Lock "cinder-quobyte-658d1365-2d4f-4fbe-acc5-c956d9710ef2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:35 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9b99027e-e72e-4e02-a95b-6159a94c2cfa tempest-CinderUnicodeTest-1757593613 None] Acquiring lock "cinder-quobyte-0a2a866b-aa1b-422b-bd14-6a92b406a1f6" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:35 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9b99027e-e72e-4e02-a95b-6159a94c2cfa tempest-CinderUnicodeTest-1757593613 None] Lock "cinder-quobyte-0a2a866b-aa1b-422b-bd14-6a92b406a1f6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:35 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-9b99027e-e72e-4e02-a95b-6159a94c2cfa tempest-CinderUnicodeTest-1757593613 None] Deleting offline snapshot 0a2a866b-aa1b-422b-bd14-6a92b406a1f6 of volume 658d1365-2d4f-4fbe-acc5-c956d9710ef2 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:26:35 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-9b99027e-e72e-4e02-a95b-6159a94c2cfa tempest-CinderUnicodeTest-1757593613 None] snapshot_file for this snap is: volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2.0a2a866b-aa1b-422b-bd14-6a92b406a1f6 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:26:35 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5714a1-3eed-46fc-b5be-ea880b268cc8]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9b99027e-e72e-4e02-a95b-6159a94c2cfa tempest-CinderUnicodeTest-1757593613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2.0a2a866b-aa1b-422b-bd14-6a92b406a1f6 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:35 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2.0a2a866b-aa1b-422b-bd14-6a92b406a1f6 Sep 28 18:26:35 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:35 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9b99027e-e72e-4e02-a95b-6159a94c2cfa tempest-CinderUnicodeTest-1757593613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2.0a2a866b-aa1b-422b-bd14-6a92b406a1f6" returned: 0 in 0.391s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:35 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-9b99027e-e72e-4e02-a95b-6159a94c2cfa tempest-CinderUnicodeTest-1757593613 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:26:35 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ba7f14-813b-44ca-9093-9ff2ded006e4]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9b99027e-e72e-4e02-a95b-6159a94c2cfa tempest-CinderUnicodeTest-1757593613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:36 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2 Sep 28 18:26:36 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:36 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9b99027e-e72e-4e02-a95b-6159a94c2cfa tempest-CinderUnicodeTest-1757593613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2" returned: 0 in 0.393s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9b99027e-e72e-4e02-a95b-6159a94c2cfa tempest-CinderUnicodeTest-1757593613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2.0a2a866b-aa1b-422b-bd14-6a92b406a1f6 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:36 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2.0a2a866b-aa1b-422b-bd14-6a92b406a1f6 Sep 28 18:26:36 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:36 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9b99027e-e72e-4e02-a95b-6159a94c2cfa tempest-CinderUnicodeTest-1757593613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2.0a2a866b-aa1b-422b-bd14-6a92b406a1f6" returned: 0 in 0.385s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9b99027e-e72e-4e02-a95b-6159a94c2cfa tempest-CinderUnicodeTest-1757593613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2.0a2a866b-aa1b-422b-bd14-6a92b406a1f6 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:36 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2.0a2a866b-aa1b-422b-bd14-6a92b406a1f6 Sep 28 18:26:36 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:37 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9b99027e-e72e-4e02-a95b-6159a94c2cfa tempest-CinderUnicodeTest-1757593613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2.0a2a866b-aa1b-422b-bd14-6a92b406a1f6" returned: 0 in 0.313s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:37 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9b99027e-e72e-4e02-a95b-6159a94c2cfa tempest-CinderUnicodeTest-1757593613 None] Lock "cinder-quobyte-0a2a866b-aa1b-422b-bd14-6a92b406a1f6" released by "_delete_snapshot" :: held 1.613s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:37 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9b99027e-e72e-4e02-a95b-6159a94c2cfa tempest-CinderUnicodeTest-1757593613 None] Lock "cinder-quobyte-658d1365-2d4f-4fbe-acc5-c956d9710ef2" released by "delete_snapshot" :: held 1.642s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:37 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-9b99027e-e72e-4e02-a95b-6159a94c2cfa tempest-CinderUnicodeTest-1757593613 None] Created reservations ['b768dd1a-b8c5-44c3-9657-de83c240fb16', '6c73a936-b4f4-4064-a2ed-6585193e55d8', 'e7daec75-c7d3-4f92-901d-6f04436b8525', '7d5d340f-83ed-4ea6-92c3-09a3730deead'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:37 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-9b99027e-e72e-4e02-a95b-6159a94c2cfa tempest-CinderUnicodeTest-1757593613 None] Delete snapshot completed successfully. Sep 28 18:26:37 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9b99027e-e72e-4e02-a95b-6159a94c2cfa tempest-CinderUnicodeTest-1757593613 None] Lock "cinder-0a2a866b-aa1b-422b-bd14-6a92b406a1f6-delete_snapshot" released by "delete_snapshot" :: held 1.811s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:37 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-be84b3aa-3092-44e7-a70a-d7ff4d3cb201 tempest-CinderUnicodeTest-1757593613 None] Acquiring lock "cinder-658d1365-2d4f-4fbe-acc5-c956d9710ef2-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:37 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-be84b3aa-3092-44e7-a70a-d7ff4d3cb201 tempest-CinderUnicodeTest-1757593613 None] Lock "cinder-658d1365-2d4f-4fbe-acc5-c956d9710ef2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:37 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-be84b3aa-3092-44e7-a70a-d7ff4d3cb201 tempest-CinderUnicodeTest-1757593613 None] Acquiring lock "cinder-quobyte-658d1365-2d4f-4fbe-acc5-c956d9710ef2" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:37 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-be84b3aa-3092-44e7-a70a-d7ff4d3cb201 tempest-CinderUnicodeTest-1757593613 None] Lock "cinder-quobyte-658d1365-2d4f-4fbe-acc5-c956d9710ef2" acquired by "delete_volume" :: waited 0.018s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:37 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa9913f-4ee8-4613-8520-ba16db203afb]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-be84b3aa-3092-44e7-a70a-d7ff4d3cb201 tempest-CinderUnicodeTest-1757593613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:37 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2 Sep 28 18:26:37 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:38 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-be84b3aa-3092-44e7-a70a-d7ff4d3cb201 tempest-CinderUnicodeTest-1757593613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2" returned: 0 in 0.469s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-be84b3aa-3092-44e7-a70a-d7ff4d3cb201 tempest-CinderUnicodeTest-1757593613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:38 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2 Sep 28 18:26:38 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:38 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-be84b3aa-3092-44e7-a70a-d7ff4d3cb201 tempest-CinderUnicodeTest-1757593613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-658d1365-2d4f-4fbe-acc5-c956d9710ef2" returned: 0 in 0.290s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:38 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-be84b3aa-3092-44e7-a70a-d7ff4d3cb201 tempest-CinderUnicodeTest-1757593613 None] Lock "cinder-quobyte-658d1365-2d4f-4fbe-acc5-c956d9710ef2" released by "delete_volume" :: held 0.834s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:38 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-be84b3aa-3092-44e7-a70a-d7ff4d3cb201 tempest-CinderUnicodeTest-1757593613 None] Created reservations ['eb190ec5-8f8a-4bdf-81bb-f274260c4451', '77a7ebbf-a670-427d-8ef1-98dc876816dd', '74a070c1-d029-4a7b-a4b5-c69cd83f205b', '86ce40a8-92c8-4bd5-92ba-4e91ae6ec201'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-be84b3aa-3092-44e7-a70a-d7ff4d3cb201 tempest-CinderUnicodeTest-1757593613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-be84b3aa-3092-44e7-a70a-d7ff4d3cb201 tempest-CinderUnicodeTest-1757593613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-be84b3aa-3092-44e7-a70a-d7ff4d3cb201 tempest-CinderUnicodeTest-1757593613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-be84b3aa-3092-44e7-a70a-d7ff4d3cb201 tempest-CinderUnicodeTest-1757593613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-be84b3aa-3092-44e7-a70a-d7ff4d3cb201 tempest-CinderUnicodeTest-1757593613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-be84b3aa-3092-44e7-a70a-d7ff4d3cb201 tempest-CinderUnicodeTest-1757593613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:38 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:26:38 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:38 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-340f36cc-016f-4e0d-b30f-ddd67cddd740 tempest-CinderUnicodeTest-1757593613 None] Acquiring lock "cinder-fa2b9d17-4165-4195-9f5c-375824b8e57b-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:38 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-340f36cc-016f-4e0d-b30f-ddd67cddd740 tempest-CinderUnicodeTest-1757593613 None] Lock "cinder-fa2b9d17-4165-4195-9f5c-375824b8e57b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:38 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-340f36cc-016f-4e0d-b30f-ddd67cddd740 tempest-CinderUnicodeTest-1757593613 None] Acquiring lock "cinder-quobyte-fa2b9d17-4165-4195-9f5c-375824b8e57b" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:38 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-340f36cc-016f-4e0d-b30f-ddd67cddd740 tempest-CinderUnicodeTest-1757593613 None] Lock "cinder-quobyte-fa2b9d17-4165-4195-9f5c-375824b8e57b" acquired by "delete_volume" :: waited 0.021s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:38 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6b2678-b7d9-43be-a957-7b579e8dbf91]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-340f36cc-016f-4e0d-b30f-ddd67cddd740 tempest-CinderUnicodeTest-1757593613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa2b9d17-4165-4195-9f5c-375824b8e57b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:39 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-be84b3aa-3092-44e7-a70a-d7ff4d3cb201 tempest-CinderUnicodeTest-1757593613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.349s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:39 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-be84b3aa-3092-44e7-a70a-d7ff4d3cb201 tempest-CinderUnicodeTest-1757593613 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:39 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-be84b3aa-3092-44e7-a70a-d7ff4d3cb201 tempest-CinderUnicodeTest-1757593613 None] Deleted volume successfully. Sep 28 18:26:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-be84b3aa-3092-44e7-a70a-d7ff4d3cb201 tempest-CinderUnicodeTest-1757593613 None] Lock "cinder-658d1365-2d4f-4fbe-acc5-c956d9710ef2-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:39 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa2b9d17-4165-4195-9f5c-375824b8e57b Sep 28 18:26:39 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:39 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-340f36cc-016f-4e0d-b30f-ddd67cddd740 tempest-CinderUnicodeTest-1757593613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa2b9d17-4165-4195-9f5c-375824b8e57b" returned: 0 in 0.467s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-340f36cc-016f-4e0d-b30f-ddd67cddd740 tempest-CinderUnicodeTest-1757593613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa2b9d17-4165-4195-9f5c-375824b8e57b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:39 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa2b9d17-4165-4195-9f5c-375824b8e57b Sep 28 18:26:39 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:39 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-340f36cc-016f-4e0d-b30f-ddd67cddd740 tempest-CinderUnicodeTest-1757593613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fa2b9d17-4165-4195-9f5c-375824b8e57b" returned: 0 in 0.313s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-340f36cc-016f-4e0d-b30f-ddd67cddd740 tempest-CinderUnicodeTest-1757593613 None] Lock "cinder-quobyte-fa2b9d17-4165-4195-9f5c-375824b8e57b" released by "delete_volume" :: held 0.826s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:39 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-340f36cc-016f-4e0d-b30f-ddd67cddd740 tempest-CinderUnicodeTest-1757593613 None] Created reservations ['2b9fd8c0-fdc4-45aa-a6e1-e0e2a7baff7b', '1325a04e-e6e5-4e83-b20a-5a150930aaf5', '13cd2176-2764-4481-85a8-a3e4504036ff', 'f3ae7528-0e7c-42b0-a4cc-3e910fd243f6'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-340f36cc-016f-4e0d-b30f-ddd67cddd740 tempest-CinderUnicodeTest-1757593613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-340f36cc-016f-4e0d-b30f-ddd67cddd740 tempest-CinderUnicodeTest-1757593613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-340f36cc-016f-4e0d-b30f-ddd67cddd740 tempest-CinderUnicodeTest-1757593613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-340f36cc-016f-4e0d-b30f-ddd67cddd740 tempest-CinderUnicodeTest-1757593613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-340f36cc-016f-4e0d-b30f-ddd67cddd740 tempest-CinderUnicodeTest-1757593613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-340f36cc-016f-4e0d-b30f-ddd67cddd740 tempest-CinderUnicodeTest-1757593613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:39 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:26:39 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:40 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-340f36cc-016f-4e0d-b30f-ddd67cddd740 tempest-CinderUnicodeTest-1757593613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.341s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:40 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-340f36cc-016f-4e0d-b30f-ddd67cddd740 tempest-CinderUnicodeTest-1757593613 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:40 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-340f36cc-016f-4e0d-b30f-ddd67cddd740 tempest-CinderUnicodeTest-1757593613 None] Deleted volume successfully. Sep 28 18:26:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-340f36cc-016f-4e0d-b30f-ddd67cddd740 tempest-CinderUnicodeTest-1757593613 None] Lock "cinder-fa2b9d17-4165-4195-9f5c-375824b8e57b-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:49 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:UPDATE=64,cinder:SELECT=50,cinder:INSERT=25,cinder:DELETE=4 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:26:50 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=48,cinder:INSERT=19,cinder:UPDATE=45,cinder:DELETE=5 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:26:54 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Flow 'volume_create_manager' (08305320-9549-4275-9905-a2034f217dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (decce6b5-5593-4d3d-9503-13ae1dac7fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (decce6b5-5593-4d3d-9503-13ae1dac7fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1024436300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1abfa59b-0165-4564-92d8-aafbbe65d224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cf845b885574bbb8de99e66113e4c9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:55Z,use_quota=True,user_id='ec33710cf1ba4b4f86cdac04528bfd8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca95c7ba-5b08-45be-8696-2eec4b6fa1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca95c7ba-5b08-45be-8696-2eec4b6fa1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d85c838-dcb0-4855-9aa1-93655d2ca0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d85c838-dcb0-4855-9aa1-93655d2ca0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1abfa59b-0165-4564-92d8-aafbbe65d224', 'volume_name': 'volume-1abfa59b-0165-4564-92d8-aafbbe65d224', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e6c933-6278-435f-a44b-14a1be839585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e6c933-6278-435f-a44b-14a1be839585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e37dde-4396-496b-a306-1428abcf384d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:54 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Volume 1abfa59b-0165-4564-92d8-aafbbe65d224: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1abfa59b-0165-4564-92d8-aafbbe65d224', 'volume_size': 1} Sep 28 18:26:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1024436300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1abfa59b-0165-4564-92d8-aafbbe65d224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cf845b885574bbb8de99e66113e4c9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:55Z,use_quota=True,user_id='ec33710cf1ba4b4f86cdac04528bfd8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Creating volume 1abfa59b-0165-4564-92d8-aafbbe65d224 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:54 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:26:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1abfa59b-0165-4564-92d8-aafbbe65d224 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:54 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1abfa59b-0165-4564-92d8-aafbbe65d224 1073741824 Sep 28 18:26:54 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:55 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1abfa59b-0165-4564-92d8-aafbbe65d224 1073741824" returned: 0 in 0.484s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1abfa59b-0165-4564-92d8-aafbbe65d224 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:55 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1abfa59b-0165-4564-92d8-aafbbe65d224 Sep 28 18:26:55 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:55 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1abfa59b-0165-4564-92d8-aafbbe65d224" returned: 0 in 0.294s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:55 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e37dde-4396-496b-a306-1428abcf384d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1abfa59b-0165-4564-92d8-aafbbe65d224', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4c4e43-9637-448d-b71d-07a432c518cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:55 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Volume volume-1abfa59b-0165-4564-92d8-aafbbe65d224 (1abfa59b-0165-4564-92d8-aafbbe65d224): created successfully Sep 28 18:26:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4c4e43-9637-448d-b71d-07a432c518cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Flow 'volume_create_manager' (08305320-9549-4275-9905-a2034f217dd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:55 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-cfd42a39-5f3d-4a12-a4eb-9ac9bd39fff6 tempest-ProjectReaderTests-966597136 None] Created volume successfully. Sep 28 18:26:56 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-49d4a583-118f-4981-858a-fea554504273 tempest-ProjectReaderTests-966597136 None] Acquiring lock "cinder-1abfa59b-0165-4564-92d8-aafbbe65d224-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:56 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-49d4a583-118f-4981-858a-fea554504273 tempest-ProjectReaderTests-966597136 None] Lock "cinder-1abfa59b-0165-4564-92d8-aafbbe65d224-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:56 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-49d4a583-118f-4981-858a-fea554504273 tempest-ProjectReaderTests-966597136 None] Acquiring lock "cinder-quobyte-1abfa59b-0165-4564-92d8-aafbbe65d224" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:26:56 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-49d4a583-118f-4981-858a-fea554504273 tempest-ProjectReaderTests-966597136 None] Lock "cinder-quobyte-1abfa59b-0165-4564-92d8-aafbbe65d224" acquired by "delete_volume" :: waited 0.015s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:26:56 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[459d39b7-cb24-4ec9-b531-e052c914cfb7]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:26:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-49d4a583-118f-4981-858a-fea554504273 tempest-ProjectReaderTests-966597136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1abfa59b-0165-4564-92d8-aafbbe65d224 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:57 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1abfa59b-0165-4564-92d8-aafbbe65d224 Sep 28 18:26:57 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:57 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-49d4a583-118f-4981-858a-fea554504273 tempest-ProjectReaderTests-966597136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1abfa59b-0165-4564-92d8-aafbbe65d224" returned: 0 in 0.382s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-49d4a583-118f-4981-858a-fea554504273 tempest-ProjectReaderTests-966597136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1abfa59b-0165-4564-92d8-aafbbe65d224 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:57 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1abfa59b-0165-4564-92d8-aafbbe65d224 Sep 28 18:26:57 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:57 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-49d4a583-118f-4981-858a-fea554504273 tempest-ProjectReaderTests-966597136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1abfa59b-0165-4564-92d8-aafbbe65d224" returned: 0 in 0.263s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:57 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-49d4a583-118f-4981-858a-fea554504273 tempest-ProjectReaderTests-966597136 None] Lock "cinder-quobyte-1abfa59b-0165-4564-92d8-aafbbe65d224" released by "delete_volume" :: held 0.695s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:57 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-49d4a583-118f-4981-858a-fea554504273 tempest-ProjectReaderTests-966597136 None] Created reservations ['2ff5c9ed-ca86-4669-9fda-399dd3e86d67', 'dc594788-8d7d-4dcb-a2d6-a5c48b215070', 'a26628f5-18b5-44f1-9f8e-291eb58bf66c', '0dbd439b-15a3-4910-88aa-ad417d440c70'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:26:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-49d4a583-118f-4981-858a-fea554504273 tempest-ProjectReaderTests-966597136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-49d4a583-118f-4981-858a-fea554504273 tempest-ProjectReaderTests-966597136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:57 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-49d4a583-118f-4981-858a-fea554504273 tempest-ProjectReaderTests-966597136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:57 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-49d4a583-118f-4981-858a-fea554504273 tempest-ProjectReaderTests-966597136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-49d4a583-118f-4981-858a-fea554504273 tempest-ProjectReaderTests-966597136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-49d4a583-118f-4981-858a-fea554504273 tempest-ProjectReaderTests-966597136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:57 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:26:57 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:58 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-49d4a583-118f-4981-858a-fea554504273 tempest-ProjectReaderTests-966597136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.308s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:58 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-49d4a583-118f-4981-858a-fea554504273 tempest-ProjectReaderTests-966597136 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:26:58 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-49d4a583-118f-4981-858a-fea554504273 tempest-ProjectReaderTests-966597136 None] Deleted volume successfully. Sep 28 18:26:58 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-49d4a583-118f-4981-858a-fea554504273 tempest-ProjectReaderTests-966597136 None] Lock "cinder-1abfa59b-0165-4564-92d8-aafbbe65d224-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:26:58 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:26:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Flow 'volume_create_manager' (86b667e4-de80-4445-91d2-9ca4045153a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23af1427-dc1f-40aa-88e3-d4a1001d5aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23af1427-dc1f-40aa-88e3-d4a1001d5aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1614246607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0194cf63-c3e1-42f7-a3ae-c99fd27da39e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cf845b885574bbb8de99e66113e4c9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:58Z,use_quota=True,user_id='ec33710cf1ba4b4f86cdac04528bfd8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84908b59-2d6f-410a-a19b-eada6af65ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84908b59-2d6f-410a-a19b-eada6af65ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a559e0-15fa-422f-a31b-834da08a1045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a559e0-15fa-422f-a31b-834da08a1045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0194cf63-c3e1-42f7-a3ae-c99fd27da39e', 'volume_name': 'volume-0194cf63-c3e1-42f7-a3ae-c99fd27da39e', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aa3d73d-c569-47d9-a123-ada2fced9a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aa3d73d-c569-47d9-a123-ada2fced9a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbea2d6b-6839-48bc-8796-f1922cd54864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:58 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Volume 0194cf63-c3e1-42f7-a3ae-c99fd27da39e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0194cf63-c3e1-42f7-a3ae-c99fd27da39e', 'volume_size': 1} Sep 28 18:26:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1614246607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0194cf63-c3e1-42f7-a3ae-c99fd27da39e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cf845b885574bbb8de99e66113e4c9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:26:58Z,use_quota=True,user_id='ec33710cf1ba4b4f86cdac04528bfd8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:26:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Creating volume 0194cf63-c3e1-42f7-a3ae-c99fd27da39e {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:26:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:26:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:26:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:26:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:26:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:26:58 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:26:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0194cf63-c3e1-42f7-a3ae-c99fd27da39e 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:58 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0194cf63-c3e1-42f7-a3ae-c99fd27da39e 1073741824 Sep 28 18:26:58 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:59 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0194cf63-c3e1-42f7-a3ae-c99fd27da39e 1073741824" returned: 0 in 0.459s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0194cf63-c3e1-42f7-a3ae-c99fd27da39e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:26:59 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0194cf63-c3e1-42f7-a3ae-c99fd27da39e Sep 28 18:26:59 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:26:59 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Sep 28 18:26:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0194cf63-c3e1-42f7-a3ae-c99fd27da39e" returned: 0 in 0.281s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:26:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:26:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:26:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbea2d6b-6839-48bc-8796-f1922cd54864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0194cf63-c3e1-42f7-a3ae-c99fd27da39e', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f326fbf1-7941-45ae-89dd-a10931fea667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:26:59 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Volume volume-0194cf63-c3e1-42f7-a3ae-c99fd27da39e (0194cf63-c3e1-42f7-a3ae-c99fd27da39e): created successfully Sep 28 18:26:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f326fbf1-7941-45ae-89dd-a10931fea667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:26:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Flow 'volume_create_manager' (86b667e4-de80-4445-91d2-9ca4045153a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:26:59 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-cb054cc3-767b-47d9-8932-6340410fa772 tempest-ProjectReaderTests-966597136 None] Created volume successfully. Sep 28 18:27:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bd8ac504-8e2f-49c5-b323-197fe887933e tempest-ProjectReaderTests-966597136 None] Acquiring lock "cinder-0194cf63-c3e1-42f7-a3ae-c99fd27da39e-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bd8ac504-8e2f-49c5-b323-197fe887933e tempest-ProjectReaderTests-966597136 None] Lock "cinder-0194cf63-c3e1-42f7-a3ae-c99fd27da39e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bd8ac504-8e2f-49c5-b323-197fe887933e tempest-ProjectReaderTests-966597136 None] Acquiring lock "cinder-quobyte-0194cf63-c3e1-42f7-a3ae-c99fd27da39e" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bd8ac504-8e2f-49c5-b323-197fe887933e tempest-ProjectReaderTests-966597136 None] Lock "cinder-quobyte-0194cf63-c3e1-42f7-a3ae-c99fd27da39e" acquired by "delete_volume" :: waited 0.016s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:00 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93c0f25-0d3d-4a84-b46f-3e02050aa22c]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bd8ac504-8e2f-49c5-b323-197fe887933e tempest-ProjectReaderTests-966597136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0194cf63-c3e1-42f7-a3ae-c99fd27da39e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:00 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0194cf63-c3e1-42f7-a3ae-c99fd27da39e Sep 28 18:27:00 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:01 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bd8ac504-8e2f-49c5-b323-197fe887933e tempest-ProjectReaderTests-966597136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0194cf63-c3e1-42f7-a3ae-c99fd27da39e" returned: 0 in 0.422s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bd8ac504-8e2f-49c5-b323-197fe887933e tempest-ProjectReaderTests-966597136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0194cf63-c3e1-42f7-a3ae-c99fd27da39e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:01 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0194cf63-c3e1-42f7-a3ae-c99fd27da39e Sep 28 18:27:01 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:01 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bd8ac504-8e2f-49c5-b323-197fe887933e tempest-ProjectReaderTests-966597136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0194cf63-c3e1-42f7-a3ae-c99fd27da39e" returned: 0 in 0.291s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bd8ac504-8e2f-49c5-b323-197fe887933e tempest-ProjectReaderTests-966597136 None] Lock "cinder-quobyte-0194cf63-c3e1-42f7-a3ae-c99fd27da39e" released by "delete_volume" :: held 0.768s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:01 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-bd8ac504-8e2f-49c5-b323-197fe887933e tempest-ProjectReaderTests-966597136 None] Created reservations ['363db554-256d-4fe0-a008-e6086eb9ca02', '548f7302-71d6-426e-884c-f7a747ff0f5d', '9ed9f938-d3b9-4b36-912a-bc60e7d5a056', '9a13f32c-93b8-4e6f-9fa3-b1e6162ecd58'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bd8ac504-8e2f-49c5-b323-197fe887933e tempest-ProjectReaderTests-966597136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bd8ac504-8e2f-49c5-b323-197fe887933e tempest-ProjectReaderTests-966597136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-bd8ac504-8e2f-49c5-b323-197fe887933e tempest-ProjectReaderTests-966597136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-bd8ac504-8e2f-49c5-b323-197fe887933e tempest-ProjectReaderTests-966597136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bd8ac504-8e2f-49c5-b323-197fe887933e tempest-ProjectReaderTests-966597136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bd8ac504-8e2f-49c5-b323-197fe887933e tempest-ProjectReaderTests-966597136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:01 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:27:01 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:01 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bd8ac504-8e2f-49c5-b323-197fe887933e tempest-ProjectReaderTests-966597136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.310s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:01 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-bd8ac504-8e2f-49c5-b323-197fe887933e tempest-ProjectReaderTests-966597136 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:01 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-bd8ac504-8e2f-49c5-b323-197fe887933e tempest-ProjectReaderTests-966597136 None] Deleted volume successfully. Sep 28 18:27:02 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bd8ac504-8e2f-49c5-b323-197fe887933e tempest-ProjectReaderTests-966597136 None] Lock "cinder-0194cf63-c3e1-42f7-a3ae-c99fd27da39e-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:02 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Flow 'volume_create_manager' (a6bd10a8-e9ec-420d-83e7-2c0693b35185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a5944a-e3cc-48d2-acef-e80d6899a2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a5944a-e3cc-48d2-acef-e80d6899a2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1435900195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25aba699-4027-485a-8af1-f318208e2046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cf845b885574bbb8de99e66113e4c9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:02Z,use_quota=True,user_id='ec33710cf1ba4b4f86cdac04528bfd8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b336007-3e68-479a-b166-7a04a97a7f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b336007-3e68-479a-b166-7a04a97a7f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd30eb19-c72a-4d82-843e-ccfd2e1f3a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd30eb19-c72a-4d82-843e-ccfd2e1f3a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25aba699-4027-485a-8af1-f318208e2046', 'volume_name': 'volume-25aba699-4027-485a-8af1-f318208e2046', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baa221ae-2a01-446a-a0db-82d9d14e9727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baa221ae-2a01-446a-a0db-82d9d14e9727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2593e21-19dc-44d3-86c4-14aba0d4b31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:02 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Volume 25aba699-4027-485a-8af1-f318208e2046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25aba699-4027-485a-8af1-f318208e2046', 'volume_size': 1} Sep 28 18:27:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1435900195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25aba699-4027-485a-8af1-f318208e2046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cf845b885574bbb8de99e66113e4c9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:02Z,use_quota=True,user_id='ec33710cf1ba4b4f86cdac04528bfd8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Creating volume 25aba699-4027-485a-8af1-f318208e2046 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:02 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:27:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-25aba699-4027-485a-8af1-f318208e2046 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:02 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-25aba699-4027-485a-8af1-f318208e2046 1073741824 Sep 28 18:27:02 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:03 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-25aba699-4027-485a-8af1-f318208e2046 1073741824" returned: 0 in 0.484s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-25aba699-4027-485a-8af1-f318208e2046 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:03 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-25aba699-4027-485a-8af1-f318208e2046 Sep 28 18:27:03 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:03 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-25aba699-4027-485a-8af1-f318208e2046" returned: 0 in 0.311s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2593e21-19dc-44d3-86c4-14aba0d4b31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25aba699-4027-485a-8af1-f318208e2046', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780e91c8-e772-42a1-9b4b-179248109895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:03 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Volume volume-25aba699-4027-485a-8af1-f318208e2046 (25aba699-4027-485a-8af1-f318208e2046): created successfully Sep 28 18:27:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780e91c8-e772-42a1-9b4b-179248109895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Flow 'volume_create_manager' (a6bd10a8-e9ec-420d-83e7-2c0693b35185) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:03 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-b0826a31-d4ea-4628-badb-9bf2f56a1169 tempest-ProjectReaderTests-966597136 None] Created volume successfully. Sep 28 18:27:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:27:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:04 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:27:04 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5f060a57-d09b-4e6a-85bd-c2b35858ba5e tempest-ProjectReaderTests-966597136 None] Acquiring lock "cinder-25aba699-4027-485a-8af1-f318208e2046-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5f060a57-d09b-4e6a-85bd-c2b35858ba5e tempest-ProjectReaderTests-966597136 None] Lock "cinder-25aba699-4027-485a-8af1-f318208e2046-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5f060a57-d09b-4e6a-85bd-c2b35858ba5e tempest-ProjectReaderTests-966597136 None] Acquiring lock "cinder-quobyte-25aba699-4027-485a-8af1-f318208e2046" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5f060a57-d09b-4e6a-85bd-c2b35858ba5e tempest-ProjectReaderTests-966597136 None] Lock "cinder-quobyte-25aba699-4027-485a-8af1-f318208e2046" acquired by "delete_volume" :: waited 0.020s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:04 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c674d57-3b02-4627-b053-2290713923f7]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5f060a57-d09b-4e6a-85bd-c2b35858ba5e tempest-ProjectReaderTests-966597136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-25aba699-4027-485a-8af1-f318208e2046 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:04 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.280s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:04 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:04 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-25aba699-4027-485a-8af1-f318208e2046 Sep 28 18:27:04 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager._thread_info {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:27:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread count: 28 {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:27:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread info: [<_MainThread(MainThread, started 129097393381504)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:27:05 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5f060a57-d09b-4e6a-85bd-c2b35858ba5e tempest-ProjectReaderTests-966597136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-25aba699-4027-485a-8af1-f318208e2046" returned: 0 in 0.422s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5f060a57-d09b-4e6a-85bd-c2b35858ba5e tempest-ProjectReaderTests-966597136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-25aba699-4027-485a-8af1-f318208e2046 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:05 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-25aba699-4027-485a-8af1-f318208e2046 Sep 28 18:27:05 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:05 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5f060a57-d09b-4e6a-85bd-c2b35858ba5e tempest-ProjectReaderTests-966597136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-25aba699-4027-485a-8af1-f318208e2046" returned: 0 in 0.262s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5f060a57-d09b-4e6a-85bd-c2b35858ba5e tempest-ProjectReaderTests-966597136 None] Lock "cinder-quobyte-25aba699-4027-485a-8af1-f318208e2046" released by "delete_volume" :: held 0.747s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:05 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-5f060a57-d09b-4e6a-85bd-c2b35858ba5e tempest-ProjectReaderTests-966597136 None] Created reservations ['4130a40a-2f0f-44fc-93b8-367a6d0b7075', '4ced0c4d-3053-4ccc-9aaa-439e9209d5ef', 'ad068588-f3b1-46b3-bb2b-046e7a172bf7', '0f47e562-7d3c-484a-b35c-d881c279e031'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5f060a57-d09b-4e6a-85bd-c2b35858ba5e tempest-ProjectReaderTests-966597136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5f060a57-d09b-4e6a-85bd-c2b35858ba5e tempest-ProjectReaderTests-966597136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-5f060a57-d09b-4e6a-85bd-c2b35858ba5e tempest-ProjectReaderTests-966597136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-5f060a57-d09b-4e6a-85bd-c2b35858ba5e tempest-ProjectReaderTests-966597136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5f060a57-d09b-4e6a-85bd-c2b35858ba5e tempest-ProjectReaderTests-966597136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5f060a57-d09b-4e6a-85bd-c2b35858ba5e tempest-ProjectReaderTests-966597136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:05 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:27:05 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:06 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5f060a57-d09b-4e6a-85bd-c2b35858ba5e tempest-ProjectReaderTests-966597136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.357s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:06 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-5f060a57-d09b-4e6a-85bd-c2b35858ba5e tempest-ProjectReaderTests-966597136 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:06 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-5f060a57-d09b-4e6a-85bd-c2b35858ba5e tempest-ProjectReaderTests-966597136 None] Deleted volume successfully. Sep 28 18:27:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-5f060a57-d09b-4e6a-85bd-c2b35858ba5e tempest-ProjectReaderTests-966597136 None] Lock "cinder-25aba699-4027-485a-8af1-f318208e2046-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:06 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Flow 'volume_create_manager' (92bb07d4-5408-4351-8af0-3f62463702a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9160507a-ac57-4c50-afab-2ef0ab9dd5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9160507a-ac57-4c50-afab-2ef0ab9dd5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1555088529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=752202fe-a514-4fd5-b7c2-b96aad73534f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cf845b885574bbb8de99e66113e4c9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:06Z,use_quota=True,user_id='ec33710cf1ba4b4f86cdac04528bfd8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129bc106-c0c8-41fc-a8f9-cc7a72111643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129bc106-c0c8-41fc-a8f9-cc7a72111643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c124fd8-f8b4-42d5-8e28-71851ab73d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c124fd8-f8b4-42d5-8e28-71851ab73d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '752202fe-a514-4fd5-b7c2-b96aad73534f', 'volume_name': 'volume-752202fe-a514-4fd5-b7c2-b96aad73534f', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250cc1da-cb54-43cf-bf0d-f570a9464f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250cc1da-cb54-43cf-bf0d-f570a9464f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c879326-2522-4913-bda6-726afbe7d079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:06 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Volume 752202fe-a514-4fd5-b7c2-b96aad73534f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-752202fe-a514-4fd5-b7c2-b96aad73534f', 'volume_size': 1} Sep 28 18:27:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1555088529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=752202fe-a514-4fd5-b7c2-b96aad73534f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cf845b885574bbb8de99e66113e4c9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:06Z,use_quota=True,user_id='ec33710cf1ba4b4f86cdac04528bfd8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Creating volume 752202fe-a514-4fd5-b7c2-b96aad73534f {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:06 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:27:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-752202fe-a514-4fd5-b7c2-b96aad73534f 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:06 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-752202fe-a514-4fd5-b7c2-b96aad73534f 1073741824 Sep 28 18:27:06 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:07 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-752202fe-a514-4fd5-b7c2-b96aad73534f 1073741824" returned: 0 in 0.452s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-752202fe-a514-4fd5-b7c2-b96aad73534f {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:07 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-752202fe-a514-4fd5-b7c2-b96aad73534f Sep 28 18:27:07 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:07 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-752202fe-a514-4fd5-b7c2-b96aad73534f" returned: 0 in 0.261s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c879326-2522-4913-bda6-726afbe7d079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-752202fe-a514-4fd5-b7c2-b96aad73534f', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e14df0-1751-4179-9869-8c2e26b7bcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:07 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Volume volume-752202fe-a514-4fd5-b7c2-b96aad73534f (752202fe-a514-4fd5-b7c2-b96aad73534f): created successfully Sep 28 18:27:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e14df0-1751-4179-9869-8c2e26b7bcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Flow 'volume_create_manager' (92bb07d4-5408-4351-8af0-3f62463702a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:07 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-9609d549-34c3-46c9-9733-13a78abd2a72 tempest-ProjectReaderTests-966597136 None] Created volume successfully. Sep 28 18:27:08 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-20bad9ef-1d0b-4d97-a601-5fff4d0ee825 tempest-ProjectReaderTests-966597136 None] Acquiring lock "cinder-752202fe-a514-4fd5-b7c2-b96aad73534f-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:08 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-20bad9ef-1d0b-4d97-a601-5fff4d0ee825 tempest-ProjectReaderTests-966597136 None] Lock "cinder-752202fe-a514-4fd5-b7c2-b96aad73534f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:08 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-20bad9ef-1d0b-4d97-a601-5fff4d0ee825 tempest-ProjectReaderTests-966597136 None] Acquiring lock "cinder-quobyte-752202fe-a514-4fd5-b7c2-b96aad73534f" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:08 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-20bad9ef-1d0b-4d97-a601-5fff4d0ee825 tempest-ProjectReaderTests-966597136 None] Lock "cinder-quobyte-752202fe-a514-4fd5-b7c2-b96aad73534f" acquired by "delete_volume" :: waited 0.017s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:08 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[33754e80-cb89-427a-9df1-2826c7a3b58e]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-20bad9ef-1d0b-4d97-a601-5fff4d0ee825 tempest-ProjectReaderTests-966597136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-752202fe-a514-4fd5-b7c2-b96aad73534f {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:08 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-752202fe-a514-4fd5-b7c2-b96aad73534f Sep 28 18:27:08 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:09 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-20bad9ef-1d0b-4d97-a601-5fff4d0ee825 tempest-ProjectReaderTests-966597136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-752202fe-a514-4fd5-b7c2-b96aad73534f" returned: 0 in 0.379s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-20bad9ef-1d0b-4d97-a601-5fff4d0ee825 tempest-ProjectReaderTests-966597136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-752202fe-a514-4fd5-b7c2-b96aad73534f {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:09 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-752202fe-a514-4fd5-b7c2-b96aad73534f Sep 28 18:27:09 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:09 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-20bad9ef-1d0b-4d97-a601-5fff4d0ee825 tempest-ProjectReaderTests-966597136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-752202fe-a514-4fd5-b7c2-b96aad73534f" returned: 0 in 0.249s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:09 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-20bad9ef-1d0b-4d97-a601-5fff4d0ee825 tempest-ProjectReaderTests-966597136 None] Lock "cinder-quobyte-752202fe-a514-4fd5-b7c2-b96aad73534f" released by "delete_volume" :: held 0.678s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:09 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-20bad9ef-1d0b-4d97-a601-5fff4d0ee825 tempest-ProjectReaderTests-966597136 None] Created reservations ['31221237-f4d4-4c97-8b24-2a4d9b1a97a4', '7ddfe946-1a32-4283-bc00-a0982fe81eb6', '93603f4e-e5ef-4757-8727-762a04592902', '7fc69ba0-08c0-4458-984a-4d2109c18ebb'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-20bad9ef-1d0b-4d97-a601-5fff4d0ee825 tempest-ProjectReaderTests-966597136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-20bad9ef-1d0b-4d97-a601-5fff4d0ee825 tempest-ProjectReaderTests-966597136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-20bad9ef-1d0b-4d97-a601-5fff4d0ee825 tempest-ProjectReaderTests-966597136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-20bad9ef-1d0b-4d97-a601-5fff4d0ee825 tempest-ProjectReaderTests-966597136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-20bad9ef-1d0b-4d97-a601-5fff4d0ee825 tempest-ProjectReaderTests-966597136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-20bad9ef-1d0b-4d97-a601-5fff4d0ee825 tempest-ProjectReaderTests-966597136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:09 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:27:09 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:09 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-20bad9ef-1d0b-4d97-a601-5fff4d0ee825 tempest-ProjectReaderTests-966597136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.276s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:09 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-20bad9ef-1d0b-4d97-a601-5fff4d0ee825 tempest-ProjectReaderTests-966597136 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:09 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-20bad9ef-1d0b-4d97-a601-5fff4d0ee825 tempest-ProjectReaderTests-966597136 None] Deleted volume successfully. Sep 28 18:27:09 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-20bad9ef-1d0b-4d97-a601-5fff4d0ee825 tempest-ProjectReaderTests-966597136 None] Lock "cinder-752202fe-a514-4fd5-b7c2-b96aad73534f-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:19 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=30,cinder:INSERT=11,cinder:UPDATE=40,cinder:DELETE=4 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:27:19 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=26,cinder:UPDATE=48,cinder:DELETE=4,cinder:INSERT=9 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:27:23 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Flow 'volume_create_manager' (ecfaa347-8bdc-41d4-8c8e-21c8adb5be10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (783df723-c0af-4f40-aeef-fb50d8bfcd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (783df723-c0af-4f40-aeef-fb50d8bfcd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1662154669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60bbdb97-e1fe-4b95-835d-5e07e2be8d7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73e4f1a6302d43b199cd0f9142249290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:23Z,use_quota=True,user_id='fdd85a90de8c461890b3df03e27fa68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125929f2-4f3d-4ff0-879d-84539d4d21d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125929f2-4f3d-4ff0-879d-84539d4d21d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e21420-6ec7-4e7b-bec2-557936460614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e21420-6ec7-4e7b-bec2-557936460614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60bbdb97-e1fe-4b95-835d-5e07e2be8d7b', 'volume_name': 'volume-60bbdb97-e1fe-4b95-835d-5e07e2be8d7b', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa2b54c-0c53-4c47-8173-30bf09a64829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa2b54c-0c53-4c47-8173-30bf09a64829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9edfa07-5ff0-4f39-8ed8-506616f30b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:23 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Volume 60bbdb97-e1fe-4b95-835d-5e07e2be8d7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60bbdb97-e1fe-4b95-835d-5e07e2be8d7b', 'volume_size': 1} Sep 28 18:27:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1662154669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60bbdb97-e1fe-4b95-835d-5e07e2be8d7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73e4f1a6302d43b199cd0f9142249290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:23Z,use_quota=True,user_id='fdd85a90de8c461890b3df03e27fa68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Creating volume 60bbdb97-e1fe-4b95-835d-5e07e2be8d7b {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:23 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:27:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-60bbdb97-e1fe-4b95-835d-5e07e2be8d7b 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:23 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-60bbdb97-e1fe-4b95-835d-5e07e2be8d7b 1073741824 Sep 28 18:27:23 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:23 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Flow 'volume_create_manager' (e5935123-2c13-4272-a4ba-5d4f80ebbebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e31c4735-6104-4e77-96cd-4082fd74cb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e31c4735-6104-4e77-96cd-4082fd74cb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-585824869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f30d483-0c31-41fa-b81b-cf3c023e787c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc136349b268469c93f607704e4f507b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:24Z,use_quota=True,user_id='89019e049c7541678192f9512dfd0615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae37a1c-e869-42d1-89c0-1c03ee17ac40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae37a1c-e869-42d1-89c0-1c03ee17ac40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfa6eba6-24ed-404d-aecf-fbbc08e0bc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfa6eba6-24ed-404d-aecf-fbbc08e0bc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f30d483-0c31-41fa-b81b-cf3c023e787c', 'volume_name': 'volume-7f30d483-0c31-41fa-b81b-cf3c023e787c', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a69a4c5-9d3b-4310-9275-4042f475d5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a69a4c5-9d3b-4310-9275-4042f475d5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b3446c-6abf-41c7-bf8e-0b284dd918bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:24 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Volume 7f30d483-0c31-41fa-b81b-cf3c023e787c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f30d483-0c31-41fa-b81b-cf3c023e787c', 'volume_size': 1} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:24 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-60bbdb97-e1fe-4b95-835d-5e07e2be8d7b 1073741824" returned: 0 in 0.795s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Flow 'volume_create_manager' (c7a36ab5-3dac-48df-ae55-7e8f460a7017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694c6aa1-e080-48cd-8be1-0fccad3d3c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-60bbdb97-e1fe-4b95-835d-5e07e2be8d7b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694c6aa1-e080-48cd-8be1-0fccad3d3c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2075366403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e62ff581-5119-4568-9438-f698746ec788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73e4f1a6302d43b199cd0f9142249290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:24Z,use_quota=True,user_id='fdd85a90de8c461890b3df03e27fa68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:24 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-60bbdb97-e1fe-4b95-835d-5e07e2be8d7b Sep 28 18:27:24 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecbdc046-2eb4-4811-a442-22ced98d6f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecbdc046-2eb4-4811-a442-22ced98d6f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59fd86c3-3990-4345-8578-80a35a5fe0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59fd86c3-3990-4345-8578-80a35a5fe0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e62ff581-5119-4568-9438-f698746ec788', 'volume_name': 'volume-e62ff581-5119-4568-9438-f698746ec788', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5fcbd73-e2b5-4f45-b441-4e274fd8b86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5fcbd73-e2b5-4f45-b441-4e274fd8b86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a78d41-deff-4001-98fa-afb0952be2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:24 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Volume e62ff581-5119-4568-9438-f698746ec788: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e62ff581-5119-4568-9438-f698746ec788', 'volume_size': 1} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Flow 'volume_create_manager' (89a05302-b636-4686-bb4e-a458cc4903ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b036c1ff-4158-4706-8b6f-0164a05f9db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:24 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b036c1ff-4158-4706-8b6f-0164a05f9db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1319464791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2524e5fb-b302-4e2d-a56a-f781bccfd016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73e4f1a6302d43b199cd0f9142249290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:24Z,use_quota=True,user_id='fdd85a90de8c461890b3df03e27fa68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4874e6af-c3e0-42f9-8f29-2309a1e44043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4874e6af-c3e0-42f9-8f29-2309a1e44043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ccc560-5c38-487e-9f3a-97555b469783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ccc560-5c38-487e-9f3a-97555b469783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2524e5fb-b302-4e2d-a56a-f781bccfd016', 'volume_name': 'volume-2524e5fb-b302-4e2d-a56a-f781bccfd016', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41cca04a-7ea3-4fa9-9b39-4ef6b08211c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41cca04a-7ea3-4fa9-9b39-4ef6b08211c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c520c9e7-d367-425d-bccc-d420d10a081f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:24 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Volume 2524e5fb-b302-4e2d-a56a-f781bccfd016: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2524e5fb-b302-4e2d-a56a-f781bccfd016', 'volume_size': 1} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-60bbdb97-e1fe-4b95-835d-5e07e2be8d7b" returned: 0 in 0.418s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.606s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-585824869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f30d483-0c31-41fa-b81b-cf3c023e787c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc136349b268469c93f607704e4f507b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:24Z,use_quota=True,user_id='89019e049c7541678192f9512dfd0615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Creating volume 7f30d483-0c31-41fa-b81b-cf3c023e787c {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:24 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9edfa07-5ff0-4f39-8ed8-506616f30b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60bbdb97-e1fe-4b95-835d-5e07e2be8d7b', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:24 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c 1073741824 Sep 28 18:27:24 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ea0c240-7dd6-4877-a070-26398c062038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:24 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Volume volume-60bbdb97-e1fe-4b95-835d-5e07e2be8d7b (60bbdb97-e1fe-4b95-835d-5e07e2be8d7b): created successfully Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ea0c240-7dd6-4877-a070-26398c062038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:24 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Flow 'volume_create_manager' (ecfaa347-8bdc-41d4-8c8e-21c8adb5be10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:24 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-156e391b-45da-44b4-898c-7657d9dea6d6 tempest-CreateVolumesFromImageTest-428566101 None] Created volume successfully. Sep 28 18:27:25 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c 1073741824" returned: 0 in 0.707s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:25 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Flow 'volume_create_manager' (9dc4ac12-4567-4ab9-92af-2966aa9517ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38370ad7-201c-4e77-ae97-6b4d3c1ff36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38370ad7-201c-4e77-ae97-6b4d3c1ff36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-514013315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d9a8f8-e052-46b2-9737-254187c86a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73e4f1a6302d43b199cd0f9142249290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:25Z,use_quota=True,user_id='fdd85a90de8c461890b3df03e27fa68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc4e8ad-d773-40aa-ad0b-bb87f4c3ffa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc4e8ad-d773-40aa-ad0b-bb87f4c3ffa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0a56e8-236a-4b6d-b531-d64429fc6f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:25 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c Sep 28 18:27:25 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0a56e8-236a-4b6d-b531-d64429fc6f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1d9a8f8-e052-46b2-9737-254187c86a66', 'volume_name': 'volume-c1d9a8f8-e052-46b2-9737-254187c86a66', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f988bace-3c1a-489b-8770-b0090cc40538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f988bace-3c1a-489b-8770-b0090cc40538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26bc6b6a-27b2-48ac-9f64-d062a7272ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:25 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Volume c1d9a8f8-e052-46b2-9737-254187c86a66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1d9a8f8-e052-46b2-9737-254187c86a66', 'volume_size': 1} Sep 28 18:27:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:25 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c" returned: 0 in 0.342s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:25 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.469s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:25 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2075366403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e62ff581-5119-4568-9438-f698746ec788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73e4f1a6302d43b199cd0f9142249290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:24Z,use_quota=True,user_id='fdd85a90de8c461890b3df03e27fa68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:25 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Creating volume e62ff581-5119-4568-9438-f698746ec788 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:25 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:25 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:25 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:25 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:27:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e62ff581-5119-4568-9438-f698746ec788 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:25 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e62ff581-5119-4568-9438-f698746ec788 1073741824 Sep 28 18:27:25 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b3446c-6abf-41c7-bf8e-0b284dd918bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f30d483-0c31-41fa-b81b-cf3c023e787c', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd273e25-733f-40fb-aad5-83b8cace91d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:26 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Volume volume-7f30d483-0c31-41fa-b81b-cf3c023e787c (7f30d483-0c31-41fa-b81b-cf3c023e787c): created successfully Sep 28 18:27:26 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd273e25-733f-40fb-aad5-83b8cace91d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:26 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Flow 'volume_create_manager' (e5935123-2c13-4272-a4ba-5d4f80ebbebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:26 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-8f06d58f-cb12-45bc-8268-a83f30a53a6e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Created volume successfully. Sep 28 18:27:26 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:26 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Flow 'volume_create_manager' (aaccc6d2-29f4-4a67-8f2c-418669925f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:26 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27649fd0-0145-4599-bdfb-a056845d2145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:26 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27649fd0-0145-4599-bdfb-a056845d2145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-330020605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192c5ca8-f0fb-4201-b382-37e1f1d13a7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73e4f1a6302d43b199cd0f9142249290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:26Z,use_quota=True,user_id='fdd85a90de8c461890b3df03e27fa68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:26 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a937db-3ff3-4a54-bea6-9fa439a58e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:26 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a937db-3ff3-4a54-bea6-9fa439a58e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:26 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d9fe327-1764-4687-b630-0a249c9b6db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:26 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d9fe327-1764-4687-b630-0a249c9b6db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '192c5ca8-f0fb-4201-b382-37e1f1d13a7d', 'volume_name': 'volume-192c5ca8-f0fb-4201-b382-37e1f1d13a7d', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:26 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5775580-e9ab-4bc8-aa4e-c472b0317478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:26 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5775580-e9ab-4bc8-aa4e-c472b0317478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:26 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824aef2b-d03f-44f5-8c60-e8066f846c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:26 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Volume 192c5ca8-f0fb-4201-b382-37e1f1d13a7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-192c5ca8-f0fb-4201-b382-37e1f1d13a7d', 'volume_size': 1} Sep 28 18:27:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b2bc93eb-6d71-4eb1-a3dd-02e2e3139c82 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:26 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e62ff581-5119-4568-9438-f698746ec788 1073741824" returned: 0 in 0.756s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e62ff581-5119-4568-9438-f698746ec788 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:26 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e62ff581-5119-4568-9438-f698746ec788 Sep 28 18:27:26 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:27 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e62ff581-5119-4568-9438-f698746ec788" returned: 0 in 0.350s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.376s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1319464791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2524e5fb-b302-4e2d-a56a-f781bccfd016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73e4f1a6302d43b199cd0f9142249290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:24Z,use_quota=True,user_id='fdd85a90de8c461890b3df03e27fa68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Creating volume 2524e5fb-b302-4e2d-a56a-f781bccfd016 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:27 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:27:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2524e5fb-b302-4e2d-a56a-f781bccfd016 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:27 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a78d41-deff-4001-98fa-afb0952be2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e62ff581-5119-4568-9438-f698746ec788', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:27 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5601410-1db8-46a1-a5eb-bbe51ef34821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:27 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2524e5fb-b302-4e2d-a56a-f781bccfd016 1073741824 Sep 28 18:27:27 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:27 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Volume volume-e62ff581-5119-4568-9438-f698746ec788 (e62ff581-5119-4568-9438-f698746ec788): created successfully Sep 28 18:27:27 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5601410-1db8-46a1-a5eb-bbe51ef34821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:27 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Flow 'volume_create_manager' (c7a36ab5-3dac-48df-ae55-7e8f460a7017) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:27 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-4defcb67-0d02-43b3-ae8f-becdad38b81a tempest-CreateVolumesFromImageTest-428566101 None] Created volume successfully. Sep 28 18:27:27 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2524e5fb-b302-4e2d-a56a-f781bccfd016 1073741824" returned: 0 in 0.616s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2524e5fb-b302-4e2d-a56a-f781bccfd016 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:27 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2524e5fb-b302-4e2d-a56a-f781bccfd016 Sep 28 18:27:27 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:28 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2524e5fb-b302-4e2d-a56a-f781bccfd016" returned: 0 in 0.322s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:28 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.443s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:28 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-514013315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d9a8f8-e052-46b2-9737-254187c86a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73e4f1a6302d43b199cd0f9142249290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:25Z,use_quota=True,user_id='fdd85a90de8c461890b3df03e27fa68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:28 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Creating volume c1d9a8f8-e052-46b2-9737-254187c86a66 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:28 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:28 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:28 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:28 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:27:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c1d9a8f8-e052-46b2-9737-254187c86a66 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c520c9e7-d367-425d-bccc-d420d10a081f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2524e5fb-b302-4e2d-a56a-f781bccfd016', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6a34791-2204-43b5-966a-3e73d9cf8e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:28 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c1d9a8f8-e052-46b2-9737-254187c86a66 1073741824 Sep 28 18:27:28 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:28 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Volume volume-2524e5fb-b302-4e2d-a56a-f781bccfd016 (2524e5fb-b302-4e2d-a56a-f781bccfd016): created successfully Sep 28 18:27:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6a34791-2204-43b5-966a-3e73d9cf8e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Flow 'volume_create_manager' (89a05302-b636-4686-bb4e-a458cc4903ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:28 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-63b77028-92ea-4812-944b-f490d5051238 tempest-CreateVolumesFromImageTest-428566101 None] Created volume successfully. Sep 28 18:27:28 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c1d9a8f8-e052-46b2-9737-254187c86a66 1073741824" returned: 0 in 0.533s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c1d9a8f8-e052-46b2-9737-254187c86a66 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:28 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c1d9a8f8-e052-46b2-9737-254187c86a66 Sep 28 18:27:28 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:28 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Flow 'volume_create_manager' (97483307-2fa6-4056-abfa-4383b0ba7392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a7977c-a2f8-4c17-ab4a-bab1df1f1ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a7977c-a2f8-4c17-ab4a-bab1df1f1ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f7b5551-9d97-41ec-abb3-737cb8f7563a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf5bee6f4a24beb9e98440af16337c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:29Z,use_quota=True,user_id='65ef5272d7ed46b2b61cf96ba0db17ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a6bed8e-9c62-42f1-98a0-215121d2c668),volume_type_id=3a6bed8e-9c62-42f1-98a0-215121d2c668)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc970d55-d5a5-48d2-a7fe-712d45df9c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc970d55-d5a5-48d2-a7fe-712d45df9c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba31a581-c092-48b1-b6d1-3c6bbacfa60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG cinder.image.glance [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Creating Keystone auth plugin from conf {{(pid=86980) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:27:29 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c1d9a8f8-e052-46b2-9737-254187c86a66" returned: 0 in 0.384s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.896s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-330020605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192c5ca8-f0fb-4201-b382-37e1f1d13a7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73e4f1a6302d43b199cd0f9142249290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:26Z,use_quota=True,user_id='fdd85a90de8c461890b3df03e27fa68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Creating volume 192c5ca8-f0fb-4201-b382-37e1f1d13a7d {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:29 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-192c5ca8-f0fb-4201-b382-37e1f1d13a7d 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:29 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-192c5ca8-f0fb-4201-b382-37e1f1d13a7d 1073741824 Sep 28 18:27:29 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26bc6b6a-27b2-48ac-9f64-d062a7272ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1d9a8f8-e052-46b2-9737-254187c86a66', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a7e2999-9af9-40ed-bcfb-e67d4cde442d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:29 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Volume volume-c1d9a8f8-e052-46b2-9737-254187c86a66 (c1d9a8f8-e052-46b2-9737-254187c86a66): created successfully Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a7e2999-9af9-40ed-bcfb-e67d4cde442d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Flow 'volume_create_manager' (9dc4ac12-4567-4ab9-92af-2966aa9517ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:29 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-29f70857-00a8-4eb2-934a-8cea561a2daf tempest-CreateVolumesFromImageTest-428566101 None] Created volume successfully. Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba31a581-c092-48b1-b6d1-3c6bbacfa60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7f7b5551-9d97-41ec-abb3-737cb8f7563a', 'volume_name': 'volume-7f7b5551-9d97-41ec-abb3-737cb8f7563a', 'volume_size': 1, 'image_id': '27afc5da-f508-4175-b55a-e83a74347e43', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/27afc5da-f508-4175-b55a-e83a74347e43', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1666e29970eb4637df0bfccd2417efbf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3cf5bee6f4a24beb9e98440af16337c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f485c13642187f67bcbcf99861582c683d853f0981588091be8a4ae1b8917c483e864f48ff968194aa7ffc93166a1b8fc930272021960214e99efd29fc121b7d', 'id': '27afc5da-f508-4175-b55a-e83a74347e43', 'created_at': datetime.datetime(2026, 9, 28, 16, 27, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 27, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/27afc5da-f508-4175-b55a-e83a74347e43/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9422a7c0-5ec3-4948-b0c7-143cc144f134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9422a7c0-5ec3-4948-b0c7-143cc144f134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd626b8f-416c-4638-890d-94fded1ae7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:29 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Volume 7f7b5551-9d97-41ec-abb3-737cb8f7563a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7f7b5551-9d97-41ec-abb3-737cb8f7563a', 'volume_size': 1, 'image_id': '27afc5da-f508-4175-b55a-e83a74347e43', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/27afc5da-f508-4175-b55a-e83a74347e43', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1666e29970eb4637df0bfccd2417efbf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3cf5bee6f4a24beb9e98440af16337c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f485c13642187f67bcbcf99861582c683d853f0981588091be8a4ae1b8917c483e864f48ff968194aa7ffc93166a1b8fc930272021960214e99efd29fc121b7d', 'id': '27afc5da-f508-4175-b55a-e83a74347e43', 'created_at': datetime.datetime(2026, 9, 28, 16, 27, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 27, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/27afc5da-f508-4175-b55a-e83a74347e43/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Trying to clone 7f7b5551-9d97-41ec-abb3-737cb8f7563a from image 27afc5da-f508-4175-b55a-e83a74347e43 at location (None, [{'url': 'file:///opt/stack/data/glance/images/27afc5da-f508-4175-b55a-e83a74347e43', 'metadata': {}}]). {{(pid=86980) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_27afc5da-f508-4175-b55a-e83a74347e43_kccyooljdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:27:29 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Image download 0.00 MB at 0.00 MB/s Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbffde3c-158b-448f-a90f-fa067411cef8]: (4, 'raw') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27afc5da-f508-4175-b55a-e83a74347e43_kccyooljdevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:29 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-192c5ca8-f0fb-4201-b382-37e1f1d13a7d 1073741824" returned: 0 in 0.655s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:29 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27afc5da-f508-4175-b55a-e83a74347e43_kccyooljdevstack@QuobyteHD Sep 28 18:27:29 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-192c5ca8-f0fb-4201-b382-37e1f1d13a7d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:29 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-192c5ca8-f0fb-4201-b382-37e1f1d13a7d Sep 28 18:27:29 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:30 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27afc5da-f508-4175-b55a-e83a74347e43_kccyooljdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27afc5da-f508-4175-b55a-e83a74347e43_kccyooljdevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:30 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-192c5ca8-f0fb-4201-b382-37e1f1d13a7d" returned: 0 in 0.302s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:30 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b2bc93eb-6d71-4eb1-a3dd-02e2e3139c82 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.622s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:30 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27afc5da-f508-4175-b55a-e83a74347e43_kccyooljdevstack@QuobyteHD Sep 28 18:27:30 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:30 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824aef2b-d03f-44f5-8c60-e8066f846c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-192c5ca8-f0fb-4201-b382-37e1f1d13a7d', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:30 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42440526-fe1d-4462-aeef-a8e8f8d71cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:30 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-b2bc93eb-6d71-4eb1-a3dd-02e2e3139c82 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Creating offline snapshot dd7a2c0e-3837-4d73-9ce2-f34903b1c282 of volume 7f30d483-0c31-41fa-b81b-cf3c023e787c {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:27:30 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Volume volume-192c5ca8-f0fb-4201-b382-37e1f1d13a7d (192c5ca8-f0fb-4201-b382-37e1f1d13a7d): created successfully Sep 28 18:27:30 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42440526-fe1d-4462-aeef-a8e8f8d71cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:30 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Flow 'volume_create_manager' (aaccc6d2-29f4-4a67-8f2c-418669925f27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:30 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[70758211-35bd-4d7e-9667-89fe942b95a5]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b2bc93eb-6d71-4eb1-a3dd-02e2e3139c82 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:30 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-296e1797-0dde-4677-b491-5073e256192e tempest-CreateVolumesFromImageTest-428566101 None] Created volume successfully. Sep 28 18:27:30 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c Sep 28 18:27:30 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:30 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27afc5da-f508-4175-b55a-e83a74347e43_kccyooljdevstack@QuobyteHD" returned: 1 in 0.392s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27afc5da-f508-4175-b55a-e83a74347e43_kccyooljdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:27:30 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Temporary image 27afc5da-f508-4175-b55a-e83a74347e43 is fetched for user 65ef5272d7ed46b2b61cf96ba0db17ce. {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:27:30 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-89fb1901-bc10-4f48-b1b6-df6833cc8eea tempest-CreateVolumesFromImageTest-428566101 None] Acquiring lock "cinder-192c5ca8-f0fb-4201-b382-37e1f1d13a7d-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:30 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-89fb1901-bc10-4f48-b1b6-df6833cc8eea tempest-CreateVolumesFromImageTest-428566101 None] Lock "cinder-192c5ca8-f0fb-4201-b382-37e1f1d13a7d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:30 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-89fb1901-bc10-4f48-b1b6-df6833cc8eea tempest-CreateVolumesFromImageTest-428566101 None] Acquiring lock "cinder-quobyte-192c5ca8-f0fb-4201-b382-37e1f1d13a7d" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:30 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[75039aaa-5942-4ca0-ba85-709302bb2348]: (4, 'raw') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27afc5da-f508-4175-b55a-e83a74347e43_kccyooljdevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:30 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-89fb1901-bc10-4f48-b1b6-df6833cc8eea tempest-CreateVolumesFromImageTest-428566101 None] Lock "cinder-quobyte-192c5ca8-f0fb-4201-b382-37e1f1d13a7d" acquired by "delete_volume" :: waited 0.047s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:30 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a7410b-0e0d-45fb-8308-6a2f54925c32]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-89fb1901-bc10-4f48-b1b6-df6833cc8eea tempest-CreateVolumesFromImageTest-428566101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-192c5ca8-f0fb-4201-b382-37e1f1d13a7d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:30 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b2bc93eb-6d71-4eb1-a3dd-02e2e3139c82 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c" returned: 0 in 0.511s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b2bc93eb-6d71-4eb1-a3dd-02e2e3139c82 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c.dd7a2c0e-3837-4d73-9ce2-f34903b1c282 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:30 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c.dd7a2c0e-3837-4d73-9ce2-f34903b1c282 1G Sep 28 18:27:30 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:30 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27afc5da-f508-4175-b55a-e83a74347e43_kccyooljdevstack@QuobyteHD Sep 28 18:27:30 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:30 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-192c5ca8-f0fb-4201-b382-37e1f1d13a7d Sep 28 18:27:30 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:31 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27afc5da-f508-4175-b55a-e83a74347e43_kccyooljdevstack@QuobyteHD" returned: 0 in 0.529s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27afc5da-f508-4175-b55a-e83a74347e43_kccyooljdevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:31 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-89fb1901-bc10-4f48-b1b6-df6833cc8eea tempest-CreateVolumesFromImageTest-428566101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-192c5ca8-f0fb-4201-b382-37e1f1d13a7d" returned: 0 in 0.521s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-89fb1901-bc10-4f48-b1b6-df6833cc8eea tempest-CreateVolumesFromImageTest-428566101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-192c5ca8-f0fb-4201-b382-37e1f1d13a7d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:31 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-192c5ca8-f0fb-4201-b382-37e1f1d13a7d Sep 28 18:27:31 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:31 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27afc5da-f508-4175-b55a-e83a74347e43_kccyooljdevstack@QuobyteHD Sep 28 18:27:31 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:31 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b2bc93eb-6d71-4eb1-a3dd-02e2e3139c82 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c.dd7a2c0e-3837-4d73-9ce2-f34903b1c282 1G" returned: 0 in 0.612s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b2bc93eb-6d71-4eb1-a3dd-02e2e3139c82 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f30d483-0c31-41fa-b81b-cf3c023e787c -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c.dd7a2c0e-3837-4d73-9ce2-f34903b1c282 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:31 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f30d483-0c31-41fa-b81b-cf3c023e787c -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c.dd7a2c0e-3837-4d73-9ce2-f34903b1c282 Sep 28 18:27:31 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:31 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27afc5da-f508-4175-b55a-e83a74347e43_kccyooljdevstack@QuobyteHD" returned: 1 in 0.398s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27afc5da-f508-4175-b55a-e83a74347e43_kccyooljdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:27:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:31 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-89fb1901-bc10-4f48-b1b6-df6833cc8eea tempest-CreateVolumesFromImageTest-428566101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-192c5ca8-f0fb-4201-b382-37e1f1d13a7d" returned: 0 in 0.364s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:31 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-89fb1901-bc10-4f48-b1b6-df6833cc8eea tempest-CreateVolumesFromImageTest-428566101 None] Lock "cinder-quobyte-192c5ca8-f0fb-4201-b382-37e1f1d13a7d" released by "delete_volume" :: held 0.968s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:31 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-89fb1901-bc10-4f48-b1b6-df6833cc8eea tempest-CreateVolumesFromImageTest-428566101 None] Created reservations ['b6400ff2-fb37-47be-9602-c148d200eae0', '29d23646-bc54-4acc-860e-20dd8e8a523d', '489b1d2c-09da-4904-8d4e-5151c7178369', '3333b837-8dc9-477f-9077-94a4e2bd6737'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-89fb1901-bc10-4f48-b1b6-df6833cc8eea tempest-CreateVolumesFromImageTest-428566101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-89fb1901-bc10-4f48-b1b6-df6833cc8eea tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:31 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-89fb1901-bc10-4f48-b1b6-df6833cc8eea tempest-CreateVolumesFromImageTest-428566101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:31 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-89fb1901-bc10-4f48-b1b6-df6833cc8eea tempest-CreateVolumesFromImageTest-428566101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-89fb1901-bc10-4f48-b1b6-df6833cc8eea tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-89fb1901-bc10-4f48-b1b6-df6833cc8eea tempest-CreateVolumesFromImageTest-428566101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:31 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:27:31 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:31 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b2bc93eb-6d71-4eb1-a3dd-02e2e3139c82 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f30d483-0c31-41fa-b81b-cf3c023e787c -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c.dd7a2c0e-3837-4d73-9ce2-f34903b1c282" returned: 0 in 0.472s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:31 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-b2bc93eb-6d71-4eb1-a3dd-02e2e3139c82 tempest-CreateVolumesFromSnapshotTest-1918207090 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c.dd7a2c0e-3837-4d73-9ce2-f34903b1c282 is being set with open permissions: ugo+rw Sep 28 18:27:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b2bc93eb-6d71-4eb1-a3dd-02e2e3139c82 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c.dd7a2c0e-3837-4d73-9ce2-f34903b1c282 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:31 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c.dd7a2c0e-3837-4d73-9ce2-f34903b1c282 Sep 28 18:27:31 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:32 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-89fb1901-bc10-4f48-b1b6-df6833cc8eea tempest-CreateVolumesFromImageTest-428566101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.313s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:32 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-89fb1901-bc10-4f48-b1b6-df6833cc8eea tempest-CreateVolumesFromImageTest-428566101 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:32 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-89fb1901-bc10-4f48-b1b6-df6833cc8eea tempest-CreateVolumesFromImageTest-428566101 None] Deleted volume successfully. Sep 28 18:27:32 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-89fb1901-bc10-4f48-b1b6-df6833cc8eea tempest-CreateVolumesFromImageTest-428566101 None] Lock "cinder-192c5ca8-f0fb-4201-b382-37e1f1d13a7d-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:32 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b2bc93eb-6d71-4eb1-a3dd-02e2e3139c82 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c.dd7a2c0e-3837-4d73-9ce2-f34903b1c282" returned: 0 in 0.345s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b2bc93eb-6d71-4eb1-a3dd-02e2e3139c82 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:32 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c.info Sep 28 18:27:32 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:32 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b2bc93eb-6d71-4eb1-a3dd-02e2e3139c82 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c.info" returned: 0 in 0.322s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:32 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-b2bc93eb-6d71-4eb1-a3dd-02e2e3139c82 tempest-CreateVolumesFromSnapshotTest-1918207090 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c.info is being set with open permissions: ugo+rw Sep 28 18:27:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b2bc93eb-6d71-4eb1-a3dd-02e2e3139c82 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:32 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c.info Sep 28 18:27:32 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:32 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bdfabfa2-9bdd-4390-887c-979c8e7ffc10 tempest-CreateVolumesFromImageTest-428566101 None] Acquiring lock "cinder-c1d9a8f8-e052-46b2-9737-254187c86a66-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:32 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bdfabfa2-9bdd-4390-887c-979c8e7ffc10 tempest-CreateVolumesFromImageTest-428566101 None] Lock "cinder-c1d9a8f8-e052-46b2-9737-254187c86a66-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:32 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bdfabfa2-9bdd-4390-887c-979c8e7ffc10 tempest-CreateVolumesFromImageTest-428566101 None] Acquiring lock "cinder-quobyte-c1d9a8f8-e052-46b2-9737-254187c86a66" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:32 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bdfabfa2-9bdd-4390-887c-979c8e7ffc10 tempest-CreateVolumesFromImageTest-428566101 None] Lock "cinder-quobyte-c1d9a8f8-e052-46b2-9737-254187c86a66" acquired by "delete_volume" :: waited 0.043s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:32 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b2bc93eb-6d71-4eb1-a3dd-02e2e3139c82 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c.info" returned: 0 in 0.450s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b2bc93eb-6d71-4eb1-a3dd-02e2e3139c82 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.875s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:33 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0df2cd-7b88-4a0a-9d57-3866e7f00fdd]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.532s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f7b5551-9d97-41ec-abb3-737cb8f7563a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf5bee6f4a24beb9e98440af16337c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:29Z,use_quota=True,user_id='65ef5272d7ed46b2b61cf96ba0db17ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a6bed8e-9c62-42f1-98a0-215121d2c668),volume_type_id=3a6bed8e-9c62-42f1-98a0-215121d2c668)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Creating volume 7f7b5551-9d97-41ec-abb3-737cb8f7563a {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:33 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:27:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f7b5551-9d97-41ec-abb3-737cb8f7563a 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bdfabfa2-9bdd-4390-887c-979c8e7ffc10 tempest-CreateVolumesFromImageTest-428566101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c1d9a8f8-e052-46b2-9737-254187c86a66 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:33 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f7b5551-9d97-41ec-abb3-737cb8f7563a 1073741824 Sep 28 18:27:33 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:33 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-b2bc93eb-6d71-4eb1-a3dd-02e2e3139c82 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Create snapshot completed successfully Sep 28 18:27:33 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c1d9a8f8-e052-46b2-9737-254187c86a66 Sep 28 18:27:33 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:33 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bdfabfa2-9bdd-4390-887c-979c8e7ffc10 tempest-CreateVolumesFromImageTest-428566101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c1d9a8f8-e052-46b2-9737-254187c86a66" returned: 0 in 0.531s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bdfabfa2-9bdd-4390-887c-979c8e7ffc10 tempest-CreateVolumesFromImageTest-428566101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c1d9a8f8-e052-46b2-9737-254187c86a66 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:33 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c1d9a8f8-e052-46b2-9737-254187c86a66 Sep 28 18:27:33 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:33 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f7b5551-9d97-41ec-abb3-737cb8f7563a 1073741824" returned: 0 in 0.788s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f7b5551-9d97-41ec-abb3-737cb8f7563a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:33 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f7b5551-9d97-41ec-abb3-737cb8f7563a Sep 28 18:27:33 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:34 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bdfabfa2-9bdd-4390-887c-979c8e7ffc10 tempest-CreateVolumesFromImageTest-428566101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c1d9a8f8-e052-46b2-9737-254187c86a66" returned: 0 in 0.502s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:34 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bdfabfa2-9bdd-4390-887c-979c8e7ffc10 tempest-CreateVolumesFromImageTest-428566101 None] Lock "cinder-quobyte-c1d9a8f8-e052-46b2-9737-254187c86a66" released by "delete_volume" :: held 1.212s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:34 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-bdfabfa2-9bdd-4390-887c-979c8e7ffc10 tempest-CreateVolumesFromImageTest-428566101 None] Created reservations ['42b434a1-7075-443a-a230-b8d93de08abc', '14feecae-d881-432d-beee-72f62333218a', '7680212a-b474-4773-bbdf-d87993dce8d4', '165e9801-9057-4cab-8aa9-afae36d3994a'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bdfabfa2-9bdd-4390-887c-979c8e7ffc10 tempest-CreateVolumesFromImageTest-428566101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bdfabfa2-9bdd-4390-887c-979c8e7ffc10 tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:34 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-bdfabfa2-9bdd-4390-887c-979c8e7ffc10 tempest-CreateVolumesFromImageTest-428566101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:34 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-bdfabfa2-9bdd-4390-887c-979c8e7ffc10 tempest-CreateVolumesFromImageTest-428566101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bdfabfa2-9bdd-4390-887c-979c8e7ffc10 tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bdfabfa2-9bdd-4390-887c-979c8e7ffc10 tempest-CreateVolumesFromImageTest-428566101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:34 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f7b5551-9d97-41ec-abb3-737cb8f7563a" returned: 0 in 0.584s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:34 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:34 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:27:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:34 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:34 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Attempting download of 27afc5da-f508-4175-b55a-e83a74347e43 ((None, [{'url': 'file:///opt/stack/data/glance/images/27afc5da-f508-4175-b55a-e83a74347e43', 'metadata': {}}])) to volume 7f7b5551-9d97-41ec-abb3-737cb8f7563a. {{(pid=86980) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:27:34 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d9ebb2-35a5-4f33-9acd-632b30cb7fd3]: (4, 'raw') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_27afc5da-f508-4175-b55a-e83a74347e43_8cafnn8z {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:34 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:34 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Flow 'volume_create_manager' (5f5bfdf5-6a8b-4382-9378-56951b3fefe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f772295-66f9-480f-9689-1e9c7e7d7d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f772295-66f9-480f-9689-1e9c7e7d7d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-327359135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e60a92-8eb6-4d0c-907c-6016ae0255e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc136349b268469c93f607704e4f507b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:35Z,use_quota=True,user_id='89019e049c7541678192f9512dfd0615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:35 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_27afc5da-f508-4175-b55a-e83a74347e43_8cafnn8z Sep 28 18:27:35 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90bce8b3-d69a-4257-b54f-3081fda5e1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90bce8b3-d69a-4257-b54f-3081fda5e1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f5cb98-b1be-4a4a-8c27-a9c37e561127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f5cb98-b1be-4a4a-8c27-a9c37e561127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56e60a92-8eb6-4d0c-907c-6016ae0255e5', 'volume_name': 'volume-56e60a92-8eb6-4d0c-907c-6016ae0255e5', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:35 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (170e0020-3309-4047-a86a-5eaf3e096f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (170e0020-3309-4047-a86a-5eaf3e096f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0325071d-521c-41ac-97c8-cac0333a5a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:35 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Volume 56e60a92-8eb6-4d0c-907c-6016ae0255e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56e60a92-8eb6-4d0c-907c-6016ae0255e5', 'volume_size': 1} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-327359135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e60a92-8eb6-4d0c-907c-6016ae0255e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc136349b268469c93f607704e4f507b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:35Z,use_quota=True,user_id='89019e049c7541678192f9512dfd0615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Creating volume 56e60a92-8eb6-4d0c-907c-6016ae0255e5 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:35 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-56e60a92-8eb6-4d0c-907c-6016ae0255e5 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bdfabfa2-9bdd-4390-887c-979c8e7ffc10 tempest-CreateVolumesFromImageTest-428566101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.680s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-bdfabfa2-9bdd-4390-887c-979c8e7ffc10 tempest-CreateVolumesFromImageTest-428566101 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:35 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-bdfabfa2-9bdd-4390-887c-979c8e7ffc10 tempest-CreateVolumesFromImageTest-428566101 None] Deleted volume successfully. Sep 28 18:27:35 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-56e60a92-8eb6-4d0c-907c-6016ae0255e5 1073741824 Sep 28 18:27:35 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bdfabfa2-9bdd-4390-887c-979c8e7ffc10 tempest-CreateVolumesFromImageTest-428566101 None] Lock "cinder-c1d9a8f8-e052-46b2-9737-254187c86a66-delete_volume" released by "delete_volume" :: held 2.434s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e5eb0db6-3e49-4c47-b4fc-515c145794aa tempest-CreateVolumesFromImageTest-428566101 None] Acquiring lock "cinder-2524e5fb-b302-4e2d-a56a-f781bccfd016-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e5eb0db6-3e49-4c47-b4fc-515c145794aa tempest-CreateVolumesFromImageTest-428566101 None] Lock "cinder-2524e5fb-b302-4e2d-a56a-f781bccfd016-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:35 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e5eb0db6-3e49-4c47-b4fc-515c145794aa tempest-CreateVolumesFromImageTest-428566101 None] Acquiring lock "cinder-quobyte-2524e5fb-b302-4e2d-a56a-f781bccfd016" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_27afc5da-f508-4175-b55a-e83a74347e43_8cafnn8z" returned: 0 in 0.849s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27afc5da-f508-4175-b55a-e83a74347e43_8cafnn8z {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e5eb0db6-3e49-4c47-b4fc-515c145794aa tempest-CreateVolumesFromImageTest-428566101 None] Lock "cinder-quobyte-2524e5fb-b302-4e2d-a56a-f781bccfd016" acquired by "delete_volume" :: waited 0.074s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[841b3d02-2892-4e25-9b69-a4b6b6417178]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e5eb0db6-3e49-4c47-b4fc-515c145794aa tempest-CreateVolumesFromImageTest-428566101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2524e5fb-b302-4e2d-a56a-f781bccfd016 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:35 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27afc5da-f508-4175-b55a-e83a74347e43_8cafnn8z Sep 28 18:27:35 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Flow 'volume_create_manager' (19cc82bc-8c79-41e0-a860-5864e6f5632a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048c10a2-72cd-46fa-aabe-caa9345a9127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:35 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2524e5fb-b302-4e2d-a56a-f781bccfd016 Sep 28 18:27:35 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048c10a2-72cd-46fa-aabe-caa9345a9127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2061797975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1611a7d7-b877-4ecb-a5cf-0848e1e433ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc136349b268469c93f607704e4f507b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:36Z,use_quota=True,user_id='89019e049c7541678192f9512dfd0615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15a32ee-c519-472a-9f7d-e2f312c86cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15a32ee-c519-472a-9f7d-e2f312c86cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9757d396-2129-4459-924a-0c5d8394524d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9757d396-2129-4459-924a-0c5d8394524d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1611a7d7-b877-4ecb-a5cf-0848e1e433ab', 'volume_name': 'volume-1611a7d7-b877-4ecb-a5cf-0848e1e433ab', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9758cd5-d434-4d2d-bc28-d422dbad230a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9758cd5-d434-4d2d-bc28-d422dbad230a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd397fc6-6b08-4f2d-9d41-6a5233ca5bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:36 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Volume 1611a7d7-b877-4ecb-a5cf-0848e1e433ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1611a7d7-b877-4ecb-a5cf-0848e1e433ab', 'volume_size': 1} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:36 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27afc5da-f508-4175-b55a-e83a74347e43_8cafnn8z" returned: 1 in 0.678s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_27afc5da-f508-4175-b55a-e83a74347e43_8cafnn8z' failed. Not Retrying. {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7303aa52-f802-4691-b2db-3ecb889dbdc7]: (4, 'raw') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27afc5da-f508-4175-b55a-e83a74347e43_kccyooljdevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:36 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-56e60a92-8eb6-4d0c-907c-6016ae0255e5 1073741824" returned: 0 in 1.199s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:36 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e5eb0db6-3e49-4c47-b4fc-515c145794aa tempest-CreateVolumesFromImageTest-428566101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2524e5fb-b302-4e2d-a56a-f781bccfd016" returned: 0 in 0.746s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e5eb0db6-3e49-4c47-b4fc-515c145794aa tempest-CreateVolumesFromImageTest-428566101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2524e5fb-b302-4e2d-a56a-f781bccfd016 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:36 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27afc5da-f508-4175-b55a-e83a74347e43_kccyooljdevstack@QuobyteHD Sep 28 18:27:36 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:36 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2524e5fb-b302-4e2d-a56a-f781bccfd016 Sep 28 18:27:36 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Flow 'volume_create_manager' (5c6ec260-f92d-4824-9f64-ab42d69080c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b813a45f-da46-46c8-906f-1d8e546b5bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b813a45f-da46-46c8-906f-1d8e546b5bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-365366236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7322db0-96e7-411c-a27d-f3ff983eaa5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc136349b268469c93f607704e4f507b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:36Z,use_quota=True,user_id='89019e049c7541678192f9512dfd0615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f29f8f-1204-4a18-8cba-e65f9ada7011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f29f8f-1204-4a18-8cba-e65f9ada7011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff2fd589-cef7-4294-a563-c5931400167d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff2fd589-cef7-4294-a563-c5931400167d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7322db0-96e7-411c-a27d-f3ff983eaa5b', 'volume_name': 'volume-f7322db0-96e7-411c-a27d-f3ff983eaa5b', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64bd3524-3655-4ebd-8ed8-68fe6af8c212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64bd3524-3655-4ebd-8ed8-68fe6af8c212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81990f50-2db5-426c-8932-7e2236bc35b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:36 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Volume f7322db0-96e7-411c-a27d-f3ff983eaa5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7322db0-96e7-411c-a27d-f3ff983eaa5b', 'volume_size': 1} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-56e60a92-8eb6-4d0c-907c-6016ae0255e5 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:36 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-56e60a92-8eb6-4d0c-907c-6016ae0255e5 Sep 28 18:27:36 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:36 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_27afc5da-f508-4175-b55a-e83a74347e43_kccyooljdevstack@QuobyteHD" returned: 0 in 0.604s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27afc5da-f508-4175-b55a-e83a74347e43_kccyooljdevstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:36 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-56e60a92-8eb6-4d0c-907c-6016ae0255e5" returned: 0 in 0.338s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] <== create_volume: return (1831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.874s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2061797975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1611a7d7-b877-4ecb-a5cf-0848e1e433ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc136349b268469c93f607704e4f507b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:36Z,use_quota=True,user_id='89019e049c7541678192f9512dfd0615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Creating volume 1611a7d7-b877-4ecb-a5cf-0848e1e433ab {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:36 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1611a7d7-b877-4ecb-a5cf-0848e1e433ab 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:36 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0325071d-521c-41ac-97c8-cac0333a5a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56e60a92-8eb6-4d0c-907c-6016ae0255e5', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b20522-0652-423f-9ac0-ffcb29f8b4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e5eb0db6-3e49-4c47-b4fc-515c145794aa tempest-CreateVolumesFromImageTest-428566101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2524e5fb-b302-4e2d-a56a-f781bccfd016" returned: 0 in 0.601s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:37 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27afc5da-f508-4175-b55a-e83a74347e43_kccyooljdevstack@QuobyteHD Sep 28 18:27:37 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:37 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1611a7d7-b877-4ecb-a5cf-0848e1e433ab 1073741824 Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e5eb0db6-3e49-4c47-b4fc-515c145794aa tempest-CreateVolumesFromImageTest-428566101 None] Lock "cinder-quobyte-2524e5fb-b302-4e2d-a56a-f781bccfd016" released by "delete_volume" :: held 1.451s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:37 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Volume volume-56e60a92-8eb6-4d0c-907c-6016ae0255e5 (56e60a92-8eb6-4d0c-907c-6016ae0255e5): created successfully Sep 28 18:27:37 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b20522-0652-423f-9ac0-ffcb29f8b4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Flow 'volume_create_manager' (5f5bfdf5-6a8b-4382-9378-56951b3fefe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:37 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-906eaabe-3ad8-49ed-a1f3-189fc5c984b0 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Created volume successfully. Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Flow 'volume_create_manager' (9b750189-e28a-4511-b39f-39c2305e9eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67578d4d-bfe8-4fd1-a4d9-68858d4d3d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-e5eb0db6-3e49-4c47-b4fc-515c145794aa tempest-CreateVolumesFromImageTest-428566101 None] Created reservations ['76d75803-0817-4419-b7ca-a9f86244a6d2', '04c290d9-1b8f-488d-9942-969436507c93', 'c3d124bc-ae10-4fd2-8780-adadda2a84f4', '81ed9bfa-73e2-458e-b366-7f11d61d6e30'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67578d4d-bfe8-4fd1-a4d9-68858d4d3d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1869804663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a64011-941a-40b7-9188-0c0c5560e8e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc136349b268469c93f607704e4f507b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:37Z,use_quota=True,user_id='89019e049c7541678192f9512dfd0615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01477d01-ba64-4fc2-9860-d3dc4cece5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01477d01-ba64-4fc2-9860-d3dc4cece5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18c0cd0-6b78-400d-95f3-6e3cece40702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18c0cd0-6b78-400d-95f3-6e3cece40702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63a64011-941a-40b7-9188-0c0c5560e8e9', 'volume_name': 'volume-63a64011-941a-40b7-9188-0c0c5560e8e9', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e474113-673d-4e19-af02-2007f6293e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e474113-673d-4e19-af02-2007f6293e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bdae1ec-2af6-4a28-be5e-34e0ff8af66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:37 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Volume 63a64011-941a-40b7-9188-0c0c5560e8e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63a64011-941a-40b7-9188-0c0c5560e8e9', 'volume_size': 1} Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e5eb0db6-3e49-4c47-b4fc-515c145794aa tempest-CreateVolumesFromImageTest-428566101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e5eb0db6-3e49-4c47-b4fc-515c145794aa tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e5eb0db6-3e49-4c47-b4fc-515c145794aa tempest-CreateVolumesFromImageTest-428566101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e5eb0db6-3e49-4c47-b4fc-515c145794aa tempest-CreateVolumesFromImageTest-428566101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e5eb0db6-3e49-4c47-b4fc-515c145794aa tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e5eb0db6-3e49-4c47-b4fc-515c145794aa tempest-CreateVolumesFromImageTest-428566101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:37 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27afc5da-f508-4175-b55a-e83a74347e43_kccyooljdevstack@QuobyteHD" returned: 1 in 0.657s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_27afc5da-f508-4175-b55a-e83a74347e43_kccyooljdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] 27afc5da-f508-4175-b55a-e83a74347e43 was raw, converting to qcow2 {{(pid=86980) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:27:37 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:27:37 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_27afc5da-f508-4175-b55a-e83a74347e43_kccyooljdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f7b5551-9d97-41ec-abb3-737cb8f7563a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:37 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_27afc5da-f508-4175-b55a-e83a74347e43_kccyooljdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f7b5551-9d97-41ec-abb3-737cb8f7563a Sep 28 18:27:37 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:37 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1611a7d7-b877-4ecb-a5cf-0848e1e433ab 1073741824" returned: 0 in 0.895s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:37 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Flow 'volume_create_manager' (411f94a3-2eff-4063-9fab-e832e21bf75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34552dba-8d41-4818-b32a-573fb1f9b649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-244d06f9-2ddd-4757-a81a-8cde31d5ab83 tempest-CreateVolumesFromImageTest-428566101 None] Acquiring lock "cinder-e62ff581-5119-4568-9438-f698746ec788-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e5eb0db6-3e49-4c47-b4fc-515c145794aa tempest-CreateVolumesFromImageTest-428566101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.507s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-e5eb0db6-3e49-4c47-b4fc-515c145794aa tempest-CreateVolumesFromImageTest-428566101 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1611a7d7-b877-4ecb-a5cf-0848e1e433ab {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:38 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-e5eb0db6-3e49-4c47-b4fc-515c145794aa tempest-CreateVolumesFromImageTest-428566101 None] Deleted volume successfully. Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34552dba-8d41-4818-b32a-573fb1f9b649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-406906049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b95e8d91-d014-4782-8bef-70b36d952bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc136349b268469c93f607704e4f507b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:38Z,use_quota=True,user_id='89019e049c7541678192f9512dfd0615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:38 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1611a7d7-b877-4ecb-a5cf-0848e1e433ab Sep 28 18:27:38 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d2ae82-a92e-44fe-b5d1-f36ddad7d37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d2ae82-a92e-44fe-b5d1-f36ddad7d37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95fbe5a6-0f10-4193-aeab-fd5b5837ce90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95fbe5a6-0f10-4193-aeab-fd5b5837ce90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b95e8d91-d014-4782-8bef-70b36d952bee', 'volume_name': 'volume-b95e8d91-d014-4782-8bef-70b36d952bee', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ce65c91-0598-4d63-941a-bb249bef9c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ce65c91-0598-4d63-941a-bb249bef9c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80853ea6-423d-4965-987a-06a74349b576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:38 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Volume b95e8d91-d014-4782-8bef-70b36d952bee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b95e8d91-d014-4782-8bef-70b36d952bee', 'volume_size': 1} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-244d06f9-2ddd-4757-a81a-8cde31d5ab83 tempest-CreateVolumesFromImageTest-428566101 None] Lock "cinder-e62ff581-5119-4568-9438-f698746ec788-delete_volume" acquired by "delete_volume" :: waited 0.152s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-e5eb0db6-3e49-4c47-b4fc-515c145794aa tempest-CreateVolumesFromImageTest-428566101 None] Lock "cinder-2524e5fb-b302-4e2d-a56a-f781bccfd016-delete_volume" released by "delete_volume" :: held 2.739s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-244d06f9-2ddd-4757-a81a-8cde31d5ab83 tempest-CreateVolumesFromImageTest-428566101 None] Acquiring lock "cinder-quobyte-e62ff581-5119-4568-9438-f698746ec788" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-244d06f9-2ddd-4757-a81a-8cde31d5ab83 tempest-CreateVolumesFromImageTest-428566101 None] Lock "cinder-quobyte-e62ff581-5119-4568-9438-f698746ec788" acquired by "delete_volume" :: waited 0.021s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2b3b9a-5290-4035-8a77-4f67584e419e]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-244d06f9-2ddd-4757-a81a-8cde31d5ab83 tempest-CreateVolumesFromImageTest-428566101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e62ff581-5119-4568-9438-f698746ec788 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:38 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_27afc5da-f508-4175-b55a-e83a74347e43_kccyooljdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f7b5551-9d97-41ec-abb3-737cb8f7563a" returned: 0 in 0.857s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_27afc5da-f508-4175-b55a-e83a74347e43_kccyooljdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f7b5551-9d97-41ec-abb3-737cb8f7563a {{(pid=86980) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:27:38 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f7b5551-9d97-41ec-abb3-737cb8f7563a 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:38 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e62ff581-5119-4568-9438-f698746ec788 Sep 28 18:27:38 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:38 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f7b5551-9d97-41ec-abb3-737cb8f7563a 1G Sep 28 18:27:38 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:38 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1611a7d7-b877-4ecb-a5cf-0848e1e433ab" returned: 0 in 0.422s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.848s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-365366236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7322db0-96e7-411c-a27d-f3ff983eaa5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc136349b268469c93f607704e4f507b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:36Z,use_quota=True,user_id='89019e049c7541678192f9512dfd0615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Creating volume f7322db0-96e7-411c-a27d-f3ff983eaa5b {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:38 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f7322db0-96e7-411c-a27d-f3ff983eaa5b 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd397fc6-6b08-4f2d-9d41-6a5233ca5bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1611a7d7-b877-4ecb-a5cf-0848e1e433ab', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d349d24c-5b6f-4dc8-a9d8-f8df6a1c989b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:38 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f7322db0-96e7-411c-a27d-f3ff983eaa5b 1073741824 Sep 28 18:27:38 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:38 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Volume volume-1611a7d7-b877-4ecb-a5cf-0848e1e433ab (1611a7d7-b877-4ecb-a5cf-0848e1e433ab): created successfully Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d349d24c-5b6f-4dc8-a9d8-f8df6a1c989b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Flow 'volume_create_manager' (19cc82bc-8c79-41e0-a860-5864e6f5632a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:38 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-a5359d05-49d8-42bc-9676-621f8d65f2d4 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Created volume successfully. Sep 28 18:27:38 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f7b5551-9d97-41ec-abb3-737cb8f7563a 1G" returned: 0 in 0.510s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Downloaded image 27afc5da-f508-4175-b55a-e83a74347e43 ((None, [{'url': 'file:///opt/stack/data/glance/images/27afc5da-f508-4175-b55a-e83a74347e43', 'metadata': {}}])) to volume 7f7b5551-9d97-41ec-abb3-737cb8f7563a successfully. {{(pid=86980) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Temporary image 27afc5da-f508-4175-b55a-e83a74347e43 for user 65ef5272d7ed46b2b61cf96ba0db17ce is deleted. {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Marking volume 7f7b5551-9d97-41ec-abb3-737cb8f7563a as bootable. {{(pid=86980) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:27:38 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-244d06f9-2ddd-4757-a81a-8cde31d5ab83 tempest-CreateVolumesFromImageTest-428566101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e62ff581-5119-4568-9438-f698746ec788" returned: 0 in 0.665s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-244d06f9-2ddd-4757-a81a-8cde31d5ab83 tempest-CreateVolumesFromImageTest-428566101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e62ff581-5119-4568-9438-f698746ec788 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Copying metadata from image 27afc5da-f508-4175-b55a-e83a74347e43 to 7f7b5551-9d97-41ec-abb3-737cb8f7563a. {{(pid=86980) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:27:38 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Creating volume glance metadata for volume 7f7b5551-9d97-41ec-abb3-737cb8f7563a backed by image 27afc5da-f508-4175-b55a-e83a74347e43 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '27afc5da-f508-4175-b55a-e83a74347e43', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1666e29970eb4637df0bfccd2417efbf', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86980) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:27:38 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e62ff581-5119-4568-9438-f698746ec788 Sep 28 18:27:38 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd626b8f-416c-4638-890d-94fded1ae7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f7b5551-9d97-41ec-abb3-737cb8f7563a', 'volume_size': 1, 'image_id': '27afc5da-f508-4175-b55a-e83a74347e43', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/27afc5da-f508-4175-b55a-e83a74347e43', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1666e29970eb4637df0bfccd2417efbf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3cf5bee6f4a24beb9e98440af16337c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f485c13642187f67bcbcf99861582c683d853f0981588091be8a4ae1b8917c483e864f48ff968194aa7ffc93166a1b8fc930272021960214e99efd29fc121b7d', 'id': '27afc5da-f508-4175-b55a-e83a74347e43', 'created_at': datetime.datetime(2026, 9, 28, 16, 27, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 27, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/27afc5da-f508-4175-b55a-e83a74347e43/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76df0091-8ade-4682-9333-6badaa37bce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:39 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Volume volume-7f7b5551-9d97-41ec-abb3-737cb8f7563a (7f7b5551-9d97-41ec-abb3-737cb8f7563a): created successfully Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76df0091-8ade-4682-9333-6badaa37bce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Flow 'volume_create_manager' (97483307-2fa6-4056-abfa-4383b0ba7392) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:39 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-d09fb31b-3e1b-4e89-92a5-8723ebb76b0a tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Created volume successfully. Sep 28 18:27:39 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f7322db0-96e7-411c-a27d-f3ff983eaa5b 1073741824" returned: 0 in 0.766s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f7322db0-96e7-411c-a27d-f3ff983eaa5b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:39 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:39 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f7322db0-96e7-411c-a27d-f3ff983eaa5b Sep 28 18:27:39 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-244d06f9-2ddd-4757-a81a-8cde31d5ab83 tempest-CreateVolumesFromImageTest-428566101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-e62ff581-5119-4568-9438-f698746ec788" returned: 0 in 0.387s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-244d06f9-2ddd-4757-a81a-8cde31d5ab83 tempest-CreateVolumesFromImageTest-428566101 None] Lock "cinder-quobyte-e62ff581-5119-4568-9438-f698746ec788" released by "delete_volume" :: held 1.116s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-244d06f9-2ddd-4757-a81a-8cde31d5ab83 tempest-CreateVolumesFromImageTest-428566101 None] Created reservations ['c1771702-f642-4651-816b-6b64c9502494', 'cd0a9fe6-0fbc-4e61-a0ea-6a937614cb08', '23a2ea84-f80c-49ad-a849-3b032ce0f816', 'ffcff3af-1a47-4952-9487-af360c84e765'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-244d06f9-2ddd-4757-a81a-8cde31d5ab83 tempest-CreateVolumesFromImageTest-428566101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-244d06f9-2ddd-4757-a81a-8cde31d5ab83 tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-244d06f9-2ddd-4757-a81a-8cde31d5ab83 tempest-CreateVolumesFromImageTest-428566101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-244d06f9-2ddd-4757-a81a-8cde31d5ab83 tempest-CreateVolumesFromImageTest-428566101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-244d06f9-2ddd-4757-a81a-8cde31d5ab83 tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-244d06f9-2ddd-4757-a81a-8cde31d5ab83 tempest-CreateVolumesFromImageTest-428566101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:39 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:27:39 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:39 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f7322db0-96e7-411c-a27d-f3ff983eaa5b" returned: 0 in 0.283s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.228s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1869804663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a64011-941a-40b7-9188-0c0c5560e8e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc136349b268469c93f607704e4f507b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:37Z,use_quota=True,user_id='89019e049c7541678192f9512dfd0615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Creating volume 63a64011-941a-40b7-9188-0c0c5560e8e9 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:39 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-63a64011-941a-40b7-9188-0c0c5560e8e9 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:39 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-63a64011-941a-40b7-9188-0c0c5560e8e9 1073741824 Sep 28 18:27:39 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81990f50-2db5-426c-8932-7e2236bc35b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7322db0-96e7-411c-a27d-f3ff983eaa5b', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3348352d-e8c0-449f-b46a-d25bc3355522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:39 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Volume volume-f7322db0-96e7-411c-a27d-f3ff983eaa5b (f7322db0-96e7-411c-a27d-f3ff983eaa5b): created successfully Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3348352d-e8c0-449f-b46a-d25bc3355522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Flow 'volume_create_manager' (5c6ec260-f92d-4824-9f64-ab42d69080c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:39 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-3fca5d1f-bcb4-4d7e-837a-db0ce3b28248 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Created volume successfully. Sep 28 18:27:39 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-244d06f9-2ddd-4757-a81a-8cde31d5ab83 tempest-CreateVolumesFromImageTest-428566101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.322s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-244d06f9-2ddd-4757-a81a-8cde31d5ab83 tempest-CreateVolumesFromImageTest-428566101 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:39 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-244d06f9-2ddd-4757-a81a-8cde31d5ab83 tempest-CreateVolumesFromImageTest-428566101 None] Deleted volume successfully. Sep 28 18:27:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-244d06f9-2ddd-4757-a81a-8cde31d5ab83 tempest-CreateVolumesFromImageTest-428566101 None] Lock "cinder-e62ff581-5119-4568-9438-f698746ec788-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:40 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-63a64011-941a-40b7-9188-0c0c5560e8e9 1073741824" returned: 0 in 0.573s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-63a64011-941a-40b7-9188-0c0c5560e8e9 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:40 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-63a64011-941a-40b7-9188-0c0c5560e8e9 Sep 28 18:27:40 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-434e039d-b583-4248-8161-e28c7f17ad12 tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Acquiring lock "cinder-7f7b5551-9d97-41ec-abb3-737cb8f7563a-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4429ac3b-6002-4062-8a9e-3b3315cbcf51 tempest-CreateVolumesFromImageTest-428566101 None] Acquiring lock "cinder-60bbdb97-e1fe-4b95-835d-5e07e2be8d7b-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-434e039d-b583-4248-8161-e28c7f17ad12 tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Lock "cinder-7f7b5551-9d97-41ec-abb3-737cb8f7563a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4429ac3b-6002-4062-8a9e-3b3315cbcf51 tempest-CreateVolumesFromImageTest-428566101 None] Lock "cinder-60bbdb97-e1fe-4b95-835d-5e07e2be8d7b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:40 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4429ac3b-6002-4062-8a9e-3b3315cbcf51 tempest-CreateVolumesFromImageTest-428566101 None] Acquiring lock "cinder-quobyte-60bbdb97-e1fe-4b95-835d-5e07e2be8d7b" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-434e039d-b583-4248-8161-e28c7f17ad12 tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Acquiring lock "cinder-quobyte-7f7b5551-9d97-41ec-abb3-737cb8f7563a" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-63a64011-941a-40b7-9188-0c0c5560e8e9" returned: 0 in 0.408s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.474s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-406906049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b95e8d91-d014-4782-8bef-70b36d952bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc136349b268469c93f607704e4f507b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:38Z,use_quota=True,user_id='89019e049c7541678192f9512dfd0615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Creating volume b95e8d91-d014-4782-8bef-70b36d952bee {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:40 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b95e8d91-d014-4782-8bef-70b36d952bee 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:40 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b95e8d91-d014-4782-8bef-70b36d952bee 1073741824 Sep 28 18:27:40 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4429ac3b-6002-4062-8a9e-3b3315cbcf51 tempest-CreateVolumesFromImageTest-428566101 None] Lock "cinder-quobyte-60bbdb97-e1fe-4b95-835d-5e07e2be8d7b" acquired by "delete_volume" :: waited 0.099s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-434e039d-b583-4248-8161-e28c7f17ad12 tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Lock "cinder-quobyte-7f7b5551-9d97-41ec-abb3-737cb8f7563a" acquired by "delete_volume" :: waited 0.120s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bdae1ec-2af6-4a28-be5e-34e0ff8af66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63a64011-941a-40b7-9188-0c0c5560e8e9', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e27e61-e8f4-40a1-9e57-afd9a1007bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dd50ec-99f8-4050-b24d-0fff77bd1516]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f9b5e5-1d66-4ab7-a7ea-06379bd90ee5]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4429ac3b-6002-4062-8a9e-3b3315cbcf51 tempest-CreateVolumesFromImageTest-428566101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-60bbdb97-e1fe-4b95-835d-5e07e2be8d7b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-434e039d-b583-4248-8161-e28c7f17ad12 tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f7b5551-9d97-41ec-abb3-737cb8f7563a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:40 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Volume volume-63a64011-941a-40b7-9188-0c0c5560e8e9 (63a64011-941a-40b7-9188-0c0c5560e8e9): created successfully Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e27e61-e8f4-40a1-9e57-afd9a1007bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:40 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Flow 'volume_create_manager' (9b750189-e28a-4511-b39f-39c2305e9eb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:40 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-3da5ee3b-1659-4308-9fc0-9d3f4feeca66 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Created volume successfully. Sep 28 18:27:40 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-60bbdb97-e1fe-4b95-835d-5e07e2be8d7b Sep 28 18:27:40 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:40 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f7b5551-9d97-41ec-abb3-737cb8f7563a Sep 28 18:27:40 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:41 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b95e8d91-d014-4782-8bef-70b36d952bee 1073741824" returned: 0 in 0.748s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:41 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-434e039d-b583-4248-8161-e28c7f17ad12 tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f7b5551-9d97-41ec-abb3-737cb8f7563a" returned: 0 in 0.690s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-434e039d-b583-4248-8161-e28c7f17ad12 tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f7b5551-9d97-41ec-abb3-737cb8f7563a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b95e8d91-d014-4782-8bef-70b36d952bee {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:41 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f7b5551-9d97-41ec-abb3-737cb8f7563a Sep 28 18:27:41 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:41 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b95e8d91-d014-4782-8bef-70b36d952bee Sep 28 18:27:41 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:41 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4429ac3b-6002-4062-8a9e-3b3315cbcf51 tempest-CreateVolumesFromImageTest-428566101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-60bbdb97-e1fe-4b95-835d-5e07e2be8d7b" returned: 0 in 0.810s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4429ac3b-6002-4062-8a9e-3b3315cbcf51 tempest-CreateVolumesFromImageTest-428566101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-60bbdb97-e1fe-4b95-835d-5e07e2be8d7b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:41 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-60bbdb97-e1fe-4b95-835d-5e07e2be8d7b Sep 28 18:27:41 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:41 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:41 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b95e8d91-d014-4782-8bef-70b36d952bee" returned: 0 in 0.361s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:41 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-434e039d-b583-4248-8161-e28c7f17ad12 tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f7b5551-9d97-41ec-abb3-737cb8f7563a" returned: 0 in 0.404s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80853ea6-423d-4965-987a-06a74349b576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b95e8d91-d014-4782-8bef-70b36d952bee', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687de5f9-7804-40c3-9e71-048b5f7fee4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-434e039d-b583-4248-8161-e28c7f17ad12 tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Lock "cinder-quobyte-7f7b5551-9d97-41ec-abb3-737cb8f7563a" released by "delete_volume" :: held 1.200s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:41 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4429ac3b-6002-4062-8a9e-3b3315cbcf51 tempest-CreateVolumesFromImageTest-428566101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-60bbdb97-e1fe-4b95-835d-5e07e2be8d7b" returned: 0 in 0.348s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4429ac3b-6002-4062-8a9e-3b3315cbcf51 tempest-CreateVolumesFromImageTest-428566101 None] Lock "cinder-quobyte-60bbdb97-e1fe-4b95-835d-5e07e2be8d7b" released by "delete_volume" :: held 1.262s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:41 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Volume volume-b95e8d91-d014-4782-8bef-70b36d952bee (b95e8d91-d014-4782-8bef-70b36d952bee): created successfully Sep 28 18:27:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687de5f9-7804-40c3-9e71-048b5f7fee4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Flow 'volume_create_manager' (411f94a3-2eff-4063-9fab-e832e21bf75b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:41 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-f26f6540-f250-4ef6-8cbd-84d6b9561940 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Created volume successfully. Sep 28 18:27:42 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-434e039d-b583-4248-8161-e28c7f17ad12 tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Created reservations ['9f3e1d32-04c7-4eab-9c18-75846051eaa1', '3a9eed3a-a1de-42a4-a6ff-901489d40f31', '7441262c-7ae3-4fc8-b487-da2002169fa4', '8efb7b51-f157-402e-9ec5-49d6e9907ab9'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:42 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-4429ac3b-6002-4062-8a9e-3b3315cbcf51 tempest-CreateVolumesFromImageTest-428566101 None] Created reservations ['7e9acb6a-cdee-43fe-b2c7-4ee25e56b643', 'e9c40530-5636-4a94-a8ac-326040170dfa', '0175a5e3-1cd2-4b63-956c-06fe6e127336', '6dcbd112-00fb-4a61-af62-e793ac7979ef'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-434e039d-b583-4248-8161-e28c7f17ad12 tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-434e039d-b583-4248-8161-e28c7f17ad12 tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-434e039d-b583-4248-8161-e28c7f17ad12 tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-434e039d-b583-4248-8161-e28c7f17ad12 tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-434e039d-b583-4248-8161-e28c7f17ad12 tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-434e039d-b583-4248-8161-e28c7f17ad12 tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:42 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:27:42 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4429ac3b-6002-4062-8a9e-3b3315cbcf51 tempest-CreateVolumesFromImageTest-428566101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4429ac3b-6002-4062-8a9e-3b3315cbcf51 tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4429ac3b-6002-4062-8a9e-3b3315cbcf51 tempest-CreateVolumesFromImageTest-428566101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4429ac3b-6002-4062-8a9e-3b3315cbcf51 tempest-CreateVolumesFromImageTest-428566101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4429ac3b-6002-4062-8a9e-3b3315cbcf51 tempest-CreateVolumesFromImageTest-428566101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4429ac3b-6002-4062-8a9e-3b3315cbcf51 tempest-CreateVolumesFromImageTest-428566101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:42 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:27:42 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:42 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-434e039d-b583-4248-8161-e28c7f17ad12 tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.307s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:42 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-434e039d-b583-4248-8161-e28c7f17ad12 tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:42 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-434e039d-b583-4248-8161-e28c7f17ad12 tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Deleted volume successfully. Sep 28 18:27:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-434e039d-b583-4248-8161-e28c7f17ad12 tempest-VolumeAndVolumeTypeFromImageTest-324426710 None] Lock "cinder-7f7b5551-9d97-41ec-abb3-737cb8f7563a-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:42 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4429ac3b-6002-4062-8a9e-3b3315cbcf51 tempest-CreateVolumesFromImageTest-428566101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.331s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:42 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-4429ac3b-6002-4062-8a9e-3b3315cbcf51 tempest-CreateVolumesFromImageTest-428566101 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:42 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-4429ac3b-6002-4062-8a9e-3b3315cbcf51 tempest-CreateVolumesFromImageTest-428566101 None] Deleted volume successfully. Sep 28 18:27:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4429ac3b-6002-4062-8a9e-3b3315cbcf51 tempest-CreateVolumesFromImageTest-428566101 None] Lock "cinder-60bbdb97-e1fe-4b95-835d-5e07e2be8d7b-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cb8861bc-fc81-45ff-ba9d-c95d8fa6ae11 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "cinder-b95e8d91-d014-4782-8bef-70b36d952bee-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cb8861bc-fc81-45ff-ba9d-c95d8fa6ae11 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-b95e8d91-d014-4782-8bef-70b36d952bee-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cb8861bc-fc81-45ff-ba9d-c95d8fa6ae11 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "cinder-quobyte-b95e8d91-d014-4782-8bef-70b36d952bee" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cb8861bc-fc81-45ff-ba9d-c95d8fa6ae11 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-quobyte-b95e8d91-d014-4782-8bef-70b36d952bee" acquired by "delete_volume" :: waited 0.029s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:43 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e71eff-3f03-4c81-b254-74c513873cb3]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cb8861bc-fc81-45ff-ba9d-c95d8fa6ae11 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b95e8d91-d014-4782-8bef-70b36d952bee {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:43 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b95e8d91-d014-4782-8bef-70b36d952bee Sep 28 18:27:43 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:43 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cb8861bc-fc81-45ff-ba9d-c95d8fa6ae11 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b95e8d91-d014-4782-8bef-70b36d952bee" returned: 0 in 0.453s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cb8861bc-fc81-45ff-ba9d-c95d8fa6ae11 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b95e8d91-d014-4782-8bef-70b36d952bee {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:43 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b95e8d91-d014-4782-8bef-70b36d952bee Sep 28 18:27:43 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:43 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cb8861bc-fc81-45ff-ba9d-c95d8fa6ae11 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b95e8d91-d014-4782-8bef-70b36d952bee" returned: 0 in 0.348s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cb8861bc-fc81-45ff-ba9d-c95d8fa6ae11 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-quobyte-b95e8d91-d014-4782-8bef-70b36d952bee" released by "delete_volume" :: held 0.878s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:44 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-cb8861bc-fc81-45ff-ba9d-c95d8fa6ae11 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Created reservations ['25f89e37-250e-4e47-9c86-aca918ae124d', 'afe53fa4-9d4f-4418-b967-07942bd857b6', 'be91ffbc-0df6-4412-bb38-0613e474bee7', '817aa42e-fa27-4a75-a260-874d9111702d'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cb8861bc-fc81-45ff-ba9d-c95d8fa6ae11 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cb8861bc-fc81-45ff-ba9d-c95d8fa6ae11 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:44 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cb8861bc-fc81-45ff-ba9d-c95d8fa6ae11 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:44 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cb8861bc-fc81-45ff-ba9d-c95d8fa6ae11 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cb8861bc-fc81-45ff-ba9d-c95d8fa6ae11 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cb8861bc-fc81-45ff-ba9d-c95d8fa6ae11 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:44 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:27:44 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:44 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cb8861bc-fc81-45ff-ba9d-c95d8fa6ae11 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.341s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:44 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-cb8861bc-fc81-45ff-ba9d-c95d8fa6ae11 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:44 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-cb8861bc-fc81-45ff-ba9d-c95d8fa6ae11 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Deleted volume successfully. Sep 28 18:27:44 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cb8861bc-fc81-45ff-ba9d-c95d8fa6ae11 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-b95e8d91-d014-4782-8bef-70b36d952bee-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:45 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f256fd5a-9595-4821-918c-77a3b01e7030 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "cinder-63a64011-941a-40b7-9188-0c0c5560e8e9-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:45 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f256fd5a-9595-4821-918c-77a3b01e7030 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-63a64011-941a-40b7-9188-0c0c5560e8e9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:45 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f256fd5a-9595-4821-918c-77a3b01e7030 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "cinder-quobyte-63a64011-941a-40b7-9188-0c0c5560e8e9" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:45 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f256fd5a-9595-4821-918c-77a3b01e7030 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-quobyte-63a64011-941a-40b7-9188-0c0c5560e8e9" acquired by "delete_volume" :: waited 0.030s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:45 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5975d446-f82c-4ee7-9d75-600d791f1474]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f256fd5a-9595-4821-918c-77a3b01e7030 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-63a64011-941a-40b7-9188-0c0c5560e8e9 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:45 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-63a64011-941a-40b7-9188-0c0c5560e8e9 Sep 28 18:27:45 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:46 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f256fd5a-9595-4821-918c-77a3b01e7030 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-63a64011-941a-40b7-9188-0c0c5560e8e9" returned: 0 in 0.566s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f256fd5a-9595-4821-918c-77a3b01e7030 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-63a64011-941a-40b7-9188-0c0c5560e8e9 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:46 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-63a64011-941a-40b7-9188-0c0c5560e8e9 Sep 28 18:27:46 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:46 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f256fd5a-9595-4821-918c-77a3b01e7030 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-63a64011-941a-40b7-9188-0c0c5560e8e9" returned: 0 in 0.403s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:46 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f256fd5a-9595-4821-918c-77a3b01e7030 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-quobyte-63a64011-941a-40b7-9188-0c0c5560e8e9" released by "delete_volume" :: held 1.045s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:46 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-f256fd5a-9595-4821-918c-77a3b01e7030 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Created reservations ['04a7056f-28c9-436f-8480-954ce611a36e', '0e8e4176-0607-40bb-ad2e-873072c02599', '4a5c5e31-2eb5-47d7-9719-d95e9e4bc410', '1aefdd2f-0392-4d7d-b4da-a6ffe08e26d3'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f256fd5a-9595-4821-918c-77a3b01e7030 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f256fd5a-9595-4821-918c-77a3b01e7030 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:46 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f256fd5a-9595-4821-918c-77a3b01e7030 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:46 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-f256fd5a-9595-4821-918c-77a3b01e7030 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-f256fd5a-9595-4821-918c-77a3b01e7030 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f256fd5a-9595-4821-918c-77a3b01e7030 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:46 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:27:46 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:47 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-f256fd5a-9595-4821-918c-77a3b01e7030 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.448s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:47 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-f256fd5a-9595-4821-918c-77a3b01e7030 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:47 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-f256fd5a-9595-4821-918c-77a3b01e7030 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Deleted volume successfully. Sep 28 18:27:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-f256fd5a-9595-4821-918c-77a3b01e7030 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-63a64011-941a-40b7-9188-0c0c5560e8e9-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-13ef8100-9153-4522-b6ec-5619824214a2 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "cinder-f7322db0-96e7-411c-a27d-f3ff983eaa5b-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-13ef8100-9153-4522-b6ec-5619824214a2 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-f7322db0-96e7-411c-a27d-f3ff983eaa5b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-13ef8100-9153-4522-b6ec-5619824214a2 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "cinder-quobyte-f7322db0-96e7-411c-a27d-f3ff983eaa5b" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-13ef8100-9153-4522-b6ec-5619824214a2 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-quobyte-f7322db0-96e7-411c-a27d-f3ff983eaa5b" acquired by "delete_volume" :: waited 0.018s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:48 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8ab210-dd41-480e-b779-6feccdbd0781]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-13ef8100-9153-4522-b6ec-5619824214a2 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f7322db0-96e7-411c-a27d-f3ff983eaa5b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:48 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f7322db0-96e7-411c-a27d-f3ff983eaa5b Sep 28 18:27:48 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:48 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-13ef8100-9153-4522-b6ec-5619824214a2 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f7322db0-96e7-411c-a27d-f3ff983eaa5b" returned: 0 in 0.561s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-13ef8100-9153-4522-b6ec-5619824214a2 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f7322db0-96e7-411c-a27d-f3ff983eaa5b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:48 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f7322db0-96e7-411c-a27d-f3ff983eaa5b Sep 28 18:27:48 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:48 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Flow 'volume_create_manager' (7fa98e69-c705-4dc3-81fc-e04907538ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4779c2d-9404-430b-86cc-22c5cf5ca970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4779c2d-9404-430b-86cc-22c5cf5ca970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-535382499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9214e6be-f639-4e1a-a709-9036dc43c0c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='573c434c26894a22b0fdf77b378284f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:49Z,use_quota=True,user_id='f5b66245f9ec48aa91b24c1e5457ae4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e74428-99c2-4c75-8f5d-2b0ac9a6a8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e74428-99c2-4c75-8f5d-2b0ac9a6a8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f57784-f597-4328-930f-a1d28fc2e772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:49 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f57784-f597-4328-930f-a1d28fc2e772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9214e6be-f639-4e1a-a709-9036dc43c0c2', 'volume_name': 'volume-9214e6be-f639-4e1a-a709-9036dc43c0c2', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84886da-b46e-4802-933f-0b6cb0688bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84886da-b46e-4802-933f-0b6cb0688bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c701fcc-46a0-4bab-8792-ba9d07607e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:49 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Volume 9214e6be-f639-4e1a-a709-9036dc43c0c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9214e6be-f639-4e1a-a709-9036dc43c0c2', 'volume_size': 1} Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-535382499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9214e6be-f639-4e1a-a709-9036dc43c0c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='573c434c26894a22b0fdf77b378284f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:49Z,use_quota=True,user_id='f5b66245f9ec48aa91b24c1e5457ae4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Creating volume 9214e6be-f639-4e1a-a709-9036dc43c0c2 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:49 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-13ef8100-9153-4522-b6ec-5619824214a2 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f7322db0-96e7-411c-a27d-f3ff983eaa5b" returned: 0 in 0.633s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:49 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2 1073741824 Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-13ef8100-9153-4522-b6ec-5619824214a2 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-quobyte-f7322db0-96e7-411c-a27d-f3ff983eaa5b" released by "delete_volume" :: held 1.294s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:49 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-13ef8100-9153-4522-b6ec-5619824214a2 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Created reservations ['307372a5-31d3-43db-ac11-ccce4c429e91', '9f359c40-94e7-4d2d-9ea0-b8096a23e596', 'bde6fdd9-0e8c-472d-8e93-c607fc283678', '2d561e44-0f05-4b37-a9be-a9638894cc2a'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-13ef8100-9153-4522-b6ec-5619824214a2 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-13ef8100-9153-4522-b6ec-5619824214a2 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-13ef8100-9153-4522-b6ec-5619824214a2 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-13ef8100-9153-4522-b6ec-5619824214a2 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-13ef8100-9153-4522-b6ec-5619824214a2 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-13ef8100-9153-4522-b6ec-5619824214a2 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:49 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:27:49 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:49 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-13ef8100-9153-4522-b6ec-5619824214a2 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.394s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-13ef8100-9153-4522-b6ec-5619824214a2 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:49 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-13ef8100-9153-4522-b6ec-5619824214a2 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Deleted volume successfully. Sep 28 18:27:49 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-13ef8100-9153-4522-b6ec-5619824214a2 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-f7322db0-96e7-411c-a27d-f3ff983eaa5b-delete_volume" released by "delete_volume" :: held 2.085s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:50 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2 1073741824" returned: 0 in 0.789s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:50 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2 Sep 28 18:27:50 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:50 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-061e792e-9f57-44d1-8ade-1e3b8a541a80 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "cinder-1611a7d7-b877-4ecb-a5cf-0848e1e433ab-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:50 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-061e792e-9f57-44d1-8ade-1e3b8a541a80 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-1611a7d7-b877-4ecb-a5cf-0848e1e433ab-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:50 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-061e792e-9f57-44d1-8ade-1e3b8a541a80 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "cinder-quobyte-1611a7d7-b877-4ecb-a5cf-0848e1e433ab" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:50 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-061e792e-9f57-44d1-8ade-1e3b8a541a80 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-quobyte-1611a7d7-b877-4ecb-a5cf-0848e1e433ab" acquired by "delete_volume" :: waited 0.028s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:50 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2" returned: 0 in 0.490s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:50 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadc06b8-0640-4c7c-9ab0-4042e6fb5df5]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-061e792e-9f57-44d1-8ade-1e3b8a541a80 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1611a7d7-b877-4ecb-a5cf-0848e1e433ab {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c701fcc-46a0-4bab-8792-ba9d07607e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9214e6be-f639-4e1a-a709-9036dc43c0c2', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734b0f99-01f3-492a-83cb-f961ab009cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:50 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Volume volume-9214e6be-f639-4e1a-a709-9036dc43c0c2 (9214e6be-f639-4e1a-a709-9036dc43c0c2): created successfully Sep 28 18:27:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734b0f99-01f3-492a-83cb-f961ab009cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Flow 'volume_create_manager' (7fa98e69-c705-4dc3-81fc-e04907538ba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:50 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-ae6cc2f9-5c3b-46b1-9dd7-886a62e1d1e5 tempest-VolumeDependencyTests-564170267 None] Created volume successfully. Sep 28 18:27:50 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1611a7d7-b877-4ecb-a5cf-0848e1e433ab Sep 28 18:27:50 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:51 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-061e792e-9f57-44d1-8ade-1e3b8a541a80 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1611a7d7-b877-4ecb-a5cf-0848e1e433ab" returned: 0 in 0.705s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-061e792e-9f57-44d1-8ade-1e3b8a541a80 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1611a7d7-b877-4ecb-a5cf-0848e1e433ab {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:51 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1611a7d7-b877-4ecb-a5cf-0848e1e433ab Sep 28 18:27:51 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Flow 'volume_create_manager' (b2105884-4de3-49e2-bdee-7dc9542b72c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce541a8-715f-41ac-ac1c-a3b1d3020f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce541a8-715f-41ac-ac1c-a3b1d3020f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-666197150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc2d273-ec91-46d1-9a90-c356a2406f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='728a709572704019bd53c7b31b8199e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:51Z,use_quota=True,user_id='c9e6d382da8146a1927ecdfa36f24aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca51d57a-ed47-4a30-b0e4-f52bbe54abe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca51d57a-ed47-4a30-b0e4-f52bbe54abe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c8c6e38-dc88-4362-8001-e3acbfffda13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c8c6e38-dc88-4362-8001-e3acbfffda13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bc2d273-ec91-46d1-9a90-c356a2406f66', 'volume_name': 'volume-5bc2d273-ec91-46d1-9a90-c356a2406f66', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c5253e-cf3d-4e18-bf31-c245b6c1e839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c5253e-cf3d-4e18-bf31-c245b6c1e839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14197912-8d17-40f0-816f-a6362537fa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:51 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Volume 5bc2d273-ec91-46d1-9a90-c356a2406f66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bc2d273-ec91-46d1-9a90-c356a2406f66', 'volume_size': 1} Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-666197150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc2d273-ec91-46d1-9a90-c356a2406f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='728a709572704019bd53c7b31b8199e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:51Z,use_quota=True,user_id='c9e6d382da8146a1927ecdfa36f24aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Creating volume 5bc2d273-ec91-46d1-9a90-c356a2406f66 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:51 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5bc2d273-ec91-46d1-9a90-c356a2406f66 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:51 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5bc2d273-ec91-46d1-9a90-c356a2406f66 1073741824 Sep 28 18:27:51 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2a08ea09-f3c6-40ba-830c-677f062f623d tempest-VolumeDependencyTests-564170267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:51 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-061e792e-9f57-44d1-8ade-1e3b8a541a80 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1611a7d7-b877-4ecb-a5cf-0848e1e433ab" returned: 0 in 0.396s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-061e792e-9f57-44d1-8ade-1e3b8a541a80 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-quobyte-1611a7d7-b877-4ecb-a5cf-0848e1e433ab" released by "delete_volume" :: held 1.186s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-061e792e-9f57-44d1-8ade-1e3b8a541a80 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Created reservations ['15b99924-dbbd-41b6-8294-500097a11b70', '7ceb6690-e8fd-42e9-b521-bac175f288d2', '9abccb8a-6c8b-4de6-b9c4-99015c2bdef5', 'c1bcd0bc-2461-4598-9d5f-2f816b2a7d2a'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-061e792e-9f57-44d1-8ade-1e3b8a541a80 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-061e792e-9f57-44d1-8ade-1e3b8a541a80 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-061e792e-9f57-44d1-8ade-1e3b8a541a80 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-061e792e-9f57-44d1-8ade-1e3b8a541a80 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-061e792e-9f57-44d1-8ade-1e3b8a541a80 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-061e792e-9f57-44d1-8ade-1e3b8a541a80 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:51 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:27:51 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:52 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-061e792e-9f57-44d1-8ade-1e3b8a541a80 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.333s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:52 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-061e792e-9f57-44d1-8ade-1e3b8a541a80 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:52 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:52 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-061e792e-9f57-44d1-8ade-1e3b8a541a80 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Deleted volume successfully. Sep 28 18:27:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5bc2d273-ec91-46d1-9a90-c356a2406f66 1073741824" returned: 0 in 0.708s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:52 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-061e792e-9f57-44d1-8ade-1e3b8a541a80 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-1611a7d7-b877-4ecb-a5cf-0848e1e433ab-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5bc2d273-ec91-46d1-9a90-c356a2406f66 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:52 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5bc2d273-ec91-46d1-9a90-c356a2406f66 Sep 28 18:27:52 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:52 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5bc2d273-ec91-46d1-9a90-c356a2406f66" returned: 0 in 0.299s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:52 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2a08ea09-f3c6-40ba-830c-677f062f623d tempest-VolumeDependencyTests-564170267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.023s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:52 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-2a08ea09-f3c6-40ba-830c-677f062f623d tempest-VolumeDependencyTests-564170267 None] Creating offline snapshot 11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17 of volume 9214e6be-f639-4e1a-a709-9036dc43c0c2 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:27:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14197912-8d17-40f0-816f-a6362537fa5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bc2d273-ec91-46d1-9a90-c356a2406f66', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74503d52-832d-4a2e-a712-2a7012a6a7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:52 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3482342-cc80-49b3-829d-ffbd3aa2640c]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a08ea09-f3c6-40ba-830c-677f062f623d tempest-VolumeDependencyTests-564170267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:52 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Volume volume-5bc2d273-ec91-46d1-9a90-c356a2406f66 (5bc2d273-ec91-46d1-9a90-c356a2406f66): created successfully Sep 28 18:27:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74503d52-832d-4a2e-a712-2a7012a6a7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Flow 'volume_create_manager' (b2105884-4de3-49e2-bdee-7dc9542b72c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:52 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-86a78591-44c0-471f-9f2e-9a7457e203ac tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Created volume successfully. Sep 28 18:27:52 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-724b4b8a-1eb6-4f15-ad19-66b982dc848e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "cinder-56e60a92-8eb6-4d0c-907c-6016ae0255e5-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:52 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-724b4b8a-1eb6-4f15-ad19-66b982dc848e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-56e60a92-8eb6-4d0c-907c-6016ae0255e5-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:52 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2 Sep 28 18:27:52 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:52 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-724b4b8a-1eb6-4f15-ad19-66b982dc848e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "cinder-quobyte-56e60a92-8eb6-4d0c-907c-6016ae0255e5" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:52 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-724b4b8a-1eb6-4f15-ad19-66b982dc848e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-quobyte-56e60a92-8eb6-4d0c-907c-6016ae0255e5" acquired by "delete_volume" :: waited 0.020s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:52 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50987c0-236f-4b24-8696-5c6ebb6e940b]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-724b4b8a-1eb6-4f15-ad19-66b982dc848e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-56e60a92-8eb6-4d0c-907c-6016ae0255e5 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:53 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-56e60a92-8eb6-4d0c-907c-6016ae0255e5 Sep 28 18:27:53 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:53 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a08ea09-f3c6-40ba-830c-677f062f623d tempest-VolumeDependencyTests-564170267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2" returned: 0 in 0.543s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a08ea09-f3c6-40ba-830c-677f062f623d tempest-VolumeDependencyTests-564170267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:53 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17 1G Sep 28 18:27:53 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:53 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-724b4b8a-1eb6-4f15-ad19-66b982dc848e tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-56e60a92-8eb6-4d0c-907c-6016ae0255e5" returned: 0 in 0.573s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-724b4b8a-1eb6-4f15-ad19-66b982dc848e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-56e60a92-8eb6-4d0c-907c-6016ae0255e5 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:53 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-56e60a92-8eb6-4d0c-907c-6016ae0255e5 Sep 28 18:27:53 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:54 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a08ea09-f3c6-40ba-830c-677f062f623d tempest-VolumeDependencyTests-564170267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17 1G" returned: 0 in 0.814s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:54 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a08ea09-f3c6-40ba-830c-677f062f623d tempest-VolumeDependencyTests-564170267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9214e6be-f639-4e1a-a709-9036dc43c0c2 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-724b4b8a-1eb6-4f15-ad19-66b982dc848e tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-56e60a92-8eb6-4d0c-907c-6016ae0255e5" returned: 0 in 0.494s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:54 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-724b4b8a-1eb6-4f15-ad19-66b982dc848e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-quobyte-56e60a92-8eb6-4d0c-907c-6016ae0255e5" released by "delete_volume" :: held 1.150s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:54 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9214e6be-f639-4e1a-a709-9036dc43c0c2 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17 Sep 28 18:27:54 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:54 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-724b4b8a-1eb6-4f15-ad19-66b982dc848e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Created reservations ['eaa43d3c-d521-4177-937f-a4f1a0743df5', 'b1bee7f9-10da-473b-90bd-3ffd5a348325', 'b98520a8-325b-4dda-a6c0-8f448c7eb856', '4aabb515-2c9b-445f-ba6a-06253fb2e50a'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:54 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Flow 'volume_create_manager' (96cfbc5b-9fd3-4c89-9a61-7810131fc0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a320b56-942b-4742-8c05-cb5d8f574fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a320b56-942b-4742-8c05-cb5d8f574fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1733979675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5021bf1d-b659-428e-931c-f4f23ee8b350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='728a709572704019bd53c7b31b8199e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:54Z,use_quota=True,user_id='c9e6d382da8146a1927ecdfa36f24aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4804941c-2526-4014-8ad3-b4166b5baf98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4804941c-2526-4014-8ad3-b4166b5baf98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e8d579-d74d-4317-835e-47a67c441477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e8d579-d74d-4317-835e-47a67c441477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5021bf1d-b659-428e-931c-f4f23ee8b350', 'volume_name': 'volume-5021bf1d-b659-428e-931c-f4f23ee8b350', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2039594b-3979-4a51-aee2-a8f9375b31a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2039594b-3979-4a51-aee2-a8f9375b31a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76720742-d27d-48ea-8917-ee808542c7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:54 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Volume 5021bf1d-b659-428e-931c-f4f23ee8b350: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5021bf1d-b659-428e-931c-f4f23ee8b350', 'volume_size': 1} Sep 28 18:27:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:54 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a08ea09-f3c6-40ba-830c-677f062f623d tempest-VolumeDependencyTests-564170267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9214e6be-f639-4e1a-a709-9036dc43c0c2 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17" returned: 0 in 0.530s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:54 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-2a08ea09-f3c6-40ba-830c-677f062f623d tempest-VolumeDependencyTests-564170267 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17 is being set with open permissions: ugo+rw Sep 28 18:27:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a08ea09-f3c6-40ba-830c-677f062f623d tempest-VolumeDependencyTests-564170267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:54 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17 Sep 28 18:27:54 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-724b4b8a-1eb6-4f15-ad19-66b982dc848e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-724b4b8a-1eb6-4f15-ad19-66b982dc848e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-724b4b8a-1eb6-4f15-ad19-66b982dc848e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-724b4b8a-1eb6-4f15-ad19-66b982dc848e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-724b4b8a-1eb6-4f15-ad19-66b982dc848e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-724b4b8a-1eb6-4f15-ad19-66b982dc848e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:54 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:27:54 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:54 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a08ea09-f3c6-40ba-830c-677f062f623d tempest-VolumeDependencyTests-564170267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17" returned: 0 in 0.393s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:54 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Flow 'volume_create_manager' (bcc484fd-bb51-4368-b5da-c45e3a5a0417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9057d5c1-dd37-4325-8e07-d243a9d16c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9057d5c1-dd37-4325-8e07-d243a9d16c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-900678657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a8f6839-a1d1-4c09-adc9-98e85c64b58f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='728a709572704019bd53c7b31b8199e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:55Z,use_quota=True,user_id='c9e6d382da8146a1927ecdfa36f24aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb4a1327-3041-4109-9edb-c80214133447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb4a1327-3041-4109-9edb-c80214133447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80380745-1524-483d-8c7d-7fe8d4c5cdd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80380745-1524-483d-8c7d-7fe8d4c5cdd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a8f6839-a1d1-4c09-adc9-98e85c64b58f', 'volume_name': 'volume-2a8f6839-a1d1-4c09-adc9-98e85c64b58f', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3374e34-4d0f-4068-ba2d-37afe8ab88bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3374e34-4d0f-4068-ba2d-37afe8ab88bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc3b8d6d-eb1e-41d7-9ebf-6a27d9a09204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:55 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Volume 2a8f6839-a1d1-4c09-adc9-98e85c64b58f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a8f6839-a1d1-4c09-adc9-98e85c64b58f', 'volume_size': 1} Sep 28 18:27:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:55 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a08ea09-f3c6-40ba-830c-677f062f623d tempest-VolumeDependencyTests-564170267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-724b4b8a-1eb6-4f15-ad19-66b982dc848e tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.511s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:55 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-724b4b8a-1eb6-4f15-ad19-66b982dc848e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:27:55 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-724b4b8a-1eb6-4f15-ad19-66b982dc848e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Deleted volume successfully. Sep 28 18:27:55 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.info Sep 28 18:27:55 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9a80c8fb-104a-4657-857c-bec996809105 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "cinder-dd7a2c0e-3837-4d73-9ce2-f34903b1c282-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-724b4b8a-1eb6-4f15-ad19-66b982dc848e tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-56e60a92-8eb6-4d0c-907c-6016ae0255e5-delete_volume" released by "delete_volume" :: held 2.413s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9a80c8fb-104a-4657-857c-bec996809105 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-dd7a2c0e-3837-4d73-9ce2-f34903b1c282-delete_snapshot" acquired by "delete_snapshot" :: waited 0.081s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9a80c8fb-104a-4657-857c-bec996809105 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "cinder-quobyte-7f30d483-0c31-41fa-b81b-cf3c023e787c" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9a80c8fb-104a-4657-857c-bec996809105 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-quobyte-7f30d483-0c31-41fa-b81b-cf3c023e787c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9a80c8fb-104a-4657-857c-bec996809105 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "cinder-quobyte-dd7a2c0e-3837-4d73-9ce2-f34903b1c282" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:27:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9a80c8fb-104a-4657-857c-bec996809105 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-quobyte-dd7a2c0e-3837-4d73-9ce2-f34903b1c282" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:27:55 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-9a80c8fb-104a-4657-857c-bec996809105 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Deleting offline snapshot dd7a2c0e-3837-4d73-9ce2-f34903b1c282 of volume 7f30d483-0c31-41fa-b81b-cf3c023e787c {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:27:55 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-9a80c8fb-104a-4657-857c-bec996809105 tempest-CreateVolumesFromSnapshotTest-1918207090 None] snapshot_file for this snap is: volume-7f30d483-0c31-41fa-b81b-cf3c023e787c.dd7a2c0e-3837-4d73-9ce2-f34903b1c282 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:27:55 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fb10f7-7ba3-4a05-9675-8b66b7677204]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9a80c8fb-104a-4657-857c-bec996809105 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c.dd7a2c0e-3837-4d73-9ce2-f34903b1c282 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:55 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c.dd7a2c0e-3837-4d73-9ce2-f34903b1c282 Sep 28 18:27:55 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:55 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a08ea09-f3c6-40ba-830c-677f062f623d tempest-VolumeDependencyTests-564170267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.info" returned: 0 in 0.457s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:55 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-2a08ea09-f3c6-40ba-830c-677f062f623d tempest-VolumeDependencyTests-564170267 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.info is being set with open permissions: ugo+rw Sep 28 18:27:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a08ea09-f3c6-40ba-830c-677f062f623d tempest-VolumeDependencyTests-564170267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:55 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.info Sep 28 18:27:55 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:55 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2a08ea09-f3c6-40ba-830c-677f062f623d tempest-VolumeDependencyTests-564170267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.info" returned: 0 in 0.383s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2a08ea09-f3c6-40ba-830c-677f062f623d tempest-VolumeDependencyTests-564170267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.416s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.484s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1733979675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5021bf1d-b659-428e-931c-f4f23ee8b350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='728a709572704019bd53c7b31b8199e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:54Z,use_quota=True,user_id='c9e6d382da8146a1927ecdfa36f24aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Creating volume 5021bf1d-b659-428e-931c-f4f23ee8b350 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:56 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:56 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:27:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5021bf1d-b659-428e-931c-f4f23ee8b350 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9a80c8fb-104a-4657-857c-bec996809105 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c.dd7a2c0e-3837-4d73-9ce2-f34903b1c282" returned: 0 in 0.632s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-9a80c8fb-104a-4657-857c-bec996809105 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f30d483-0c31-41fa-b81b-cf3c023e787c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:27:56 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5021bf1d-b659-428e-931c-f4f23ee8b350 1073741824 Sep 28 18:27:56 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:56 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cad99d-19de-4ea4-9da8-e3d81d96bd41]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:27:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9a80c8fb-104a-4657-857c-bec996809105 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:56 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c Sep 28 18:27:56 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:56 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5021bf1d-b659-428e-931c-f4f23ee8b350 1073741824" returned: 0 in 0.496s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:56 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9a80c8fb-104a-4657-857c-bec996809105 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c" returned: 0 in 0.452s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9a80c8fb-104a-4657-857c-bec996809105 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c.dd7a2c0e-3837-4d73-9ce2-f34903b1c282 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:56 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c.dd7a2c0e-3837-4d73-9ce2-f34903b1c282 Sep 28 18:27:56 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:56 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9a80c8fb-104a-4657-857c-bec996809105 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c.dd7a2c0e-3837-4d73-9ce2-f34903b1c282" returned: 0 in 0.393s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9a80c8fb-104a-4657-857c-bec996809105 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c.dd7a2c0e-3837-4d73-9ce2-f34903b1c282 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:56 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c.dd7a2c0e-3837-4d73-9ce2-f34903b1c282 Sep 28 18:27:56 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:57 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-9a80c8fb-104a-4657-857c-bec996809105 tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c.dd7a2c0e-3837-4d73-9ce2-f34903b1c282" returned: 0 in 0.255s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:57 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9a80c8fb-104a-4657-857c-bec996809105 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-quobyte-dd7a2c0e-3837-4d73-9ce2-f34903b1c282" released by "_delete_snapshot" :: held 1.883s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:57 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9a80c8fb-104a-4657-857c-bec996809105 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-quobyte-7f30d483-0c31-41fa-b81b-cf3c023e787c" released by "delete_snapshot" :: held 1.911s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:27:57 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-2a08ea09-f3c6-40ba-830c-677f062f623d tempest-VolumeDependencyTests-564170267 None] Create snapshot completed successfully Sep 28 18:27:57 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-9a80c8fb-104a-4657-857c-bec996809105 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Created reservations ['4cd4935a-400a-49b1-b7a0-fd91769d7e95', '412c36d0-eeec-441c-89f5-a1f3a733e5c3', 'f302518c-4de6-4e97-be4b-461ec6229394', 'edb73331-2f9a-41ba-b29c-95b26df25173'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:27:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5021bf1d-b659-428e-931c-f4f23ee8b350 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:58 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:27:58 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5021bf1d-b659-428e-931c-f4f23ee8b350 Sep 28 18:27:58 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Flow 'volume_create_manager' (e50c2184-b352-41d9-917d-ba16e9c7b0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:27:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d97362-439c-47ba-a0c4-cabc2437576c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d97362-439c-47ba-a0c4-cabc2437576c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1748084318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a9c3a67-fcee-4841-93eb-274a87b18b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='728a709572704019bd53c7b31b8199e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:56Z,use_quota=True,user_id='c9e6d382da8146a1927ecdfa36f24aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b683b958-ed61-47cd-9f6b-3f3dab55f813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b683b958-ed61-47cd-9f6b-3f3dab55f813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c73ddb-d5b1-432d-a1ee-0df270310fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c73ddb-d5b1-432d-a1ee-0df270310fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a9c3a67-fcee-4841-93eb-274a87b18b4e', 'volume_name': 'volume-7a9c3a67-fcee-4841-93eb-274a87b18b4e', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68fc2ed6-7a33-4e49-a32c-09f4080c5035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68fc2ed6-7a33-4e49-a32c-09f4080c5035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce94d80d-3690-467c-b7fc-7c239ebde35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:27:58 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Volume 7a9c3a67-fcee-4841-93eb-274a87b18b4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a9c3a67-fcee-4841-93eb-274a87b18b4e', 'volume_size': 1} Sep 28 18:27:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:58 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5021bf1d-b659-428e-931c-f4f23ee8b350" returned: 0 in 0.342s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] <== create_volume: return (2458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:27:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.478s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.420s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-900678657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a8f6839-a1d1-4c09-adc9-98e85c64b58f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='728a709572704019bd53c7b31b8199e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:55Z,use_quota=True,user_id='c9e6d382da8146a1927ecdfa36f24aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:27:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Creating volume 2a8f6839-a1d1-4c09-adc9-98e85c64b58f {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:27:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:27:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:27:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:27:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:27:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:27:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:27:58 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:27:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a8f6839-a1d1-4c09-adc9-98e85c64b58f 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:27:58 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a8f6839-a1d1-4c09-adc9-98e85c64b58f 1073741824 Sep 28 18:27:58 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:27:58 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 28 18:27:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a8f6839-a1d1-4c09-adc9-98e85c64b58f 1073741824" returned: 0 in 0.462s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:27:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76720742-d27d-48ea-8917-ee808542c7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5021bf1d-b659-428e-931c-f4f23ee8b350', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:27:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9fb5fd-abad-4970-abc4-0b25f12dd474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:00 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Volume volume-5021bf1d-b659-428e-931c-f4f23ee8b350 (5021bf1d-b659-428e-931c-f4f23ee8b350): created successfully Sep 28 18:28:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9fb5fd-abad-4970-abc4-0b25f12dd474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Flow 'volume_create_manager' (96cfbc5b-9fd3-4c89-9a61-7810131fc0b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a8f6839-a1d1-4c09-adc9-98e85c64b58f {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:01 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-9a80c8fb-104a-4657-857c-bec996809105 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Delete snapshot completed successfully. Sep 28 18:28:01 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-1192c1d5-32da-4a9a-bb99-77f21ce8e3bb tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Created volume successfully. Sep 28 18:28:01 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a8f6839-a1d1-4c09-adc9-98e85c64b58f Sep 28 18:28:01 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-9a80c8fb-104a-4657-857c-bec996809105 tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-dd7a2c0e-3837-4d73-9ce2-f34903b1c282-delete_snapshot" released by "delete_snapshot" :: held 5.755s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Flow 'volume_create_manager' (d4eaaf24-bbda-4ee4-bd10-dd841c99989b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2754d20-033d-4eee-aedc-6a9ac6d81822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2754d20-033d-4eee-aedc-6a9ac6d81822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1097851703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97fc03e-a3dd-4b46-864d-1f061fa0fa1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='728a709572704019bd53c7b31b8199e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:01Z,use_quota=True,user_id='c9e6d382da8146a1927ecdfa36f24aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb6b8f6-8ed8-4998-a7b1-18dab7269355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb6b8f6-8ed8-4998-a7b1-18dab7269355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eeb68cd-243a-4ef0-b920-7949944ddfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eeb68cd-243a-4ef0-b920-7949944ddfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c97fc03e-a3dd-4b46-864d-1f061fa0fa1c', 'volume_name': 'volume-c97fc03e-a3dd-4b46-864d-1f061fa0fa1c', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2113940-b347-4af0-8a28-937425351998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2113940-b347-4af0-8a28-937425351998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08b99f03-b5e8-4d1b-92eb-257b3c4a900a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:01 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Volume c97fc03e-a3dd-4b46-864d-1f061fa0fa1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c97fc03e-a3dd-4b46-864d-1f061fa0fa1c', 'volume_size': 1} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-420c6901-850e-4143-96d4-3eb1cf3f0bff tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "cinder-7f30d483-0c31-41fa-b81b-cf3c023e787c-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-420c6901-850e-4143-96d4-3eb1cf3f0bff tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-7f30d483-0c31-41fa-b81b-cf3c023e787c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-420c6901-850e-4143-96d4-3eb1cf3f0bff tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "cinder-quobyte-7f30d483-0c31-41fa-b81b-cf3c023e787c" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:01 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a8f6839-a1d1-4c09-adc9-98e85c64b58f" returned: 0 in 0.712s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] <== create_volume: return (3186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.190s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.450s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1748084318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a9c3a67-fcee-4841-93eb-274a87b18b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='728a709572704019bd53c7b31b8199e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:27:56Z,use_quota=True,user_id='c9e6d382da8146a1927ecdfa36f24aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Creating volume 7a9c3a67-fcee-4841-93eb-274a87b18b4e {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:28:01 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7a9c3a67-fcee-4841-93eb-274a87b18b4e 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-420c6901-850e-4143-96d4-3eb1cf3f0bff tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-quobyte-7f30d483-0c31-41fa-b81b-cf3c023e787c" acquired by "delete_volume" :: waited 0.065s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:01 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7a9c3a67-fcee-4841-93eb-274a87b18b4e 1073741824 Sep 28 18:28:01 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc3b8d6d-eb1e-41d7-9ebf-6a27d9a09204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a8f6839-a1d1-4c09-adc9-98e85c64b58f', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (074b4d90-fe3e-4013-9be2-14fb184f2ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d35ed9-c71d-4937-9f86-b0cb64a70bdb]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-420c6901-850e-4143-96d4-3eb1cf3f0bff tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:01 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Volume volume-2a8f6839-a1d1-4c09-adc9-98e85c64b58f (2a8f6839-a1d1-4c09-adc9-98e85c64b58f): created successfully Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (074b4d90-fe3e-4013-9be2-14fb184f2ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:01 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Flow 'volume_create_manager' (bcc484fd-bb51-4368-b5da-c45e3a5a0417) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:01 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-eac1e865-1698-4c23-af10-ce3b989bdc31 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Created volume successfully. Sep 28 18:28:02 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:28:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Flow 'volume_create_manager' (56ac99fd-40af-4982-b5b0-79221d69c214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82fe761-de15-4b53-ac7f-3d21b52b5918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82fe761-de15-4b53-ac7f-3d21b52b5918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-451844459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ee87aa-4765-4f80-ae65-18849005cba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='573c434c26894a22b0fdf77b378284f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:02Z,use_quota=True,user_id='f5b66245f9ec48aa91b24c1e5457ae4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d53e439-be69-48ce-aac0-232ee6d5fbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d53e439-be69-48ce-aac0-232ee6d5fbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:02 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c Sep 28 18:28:02 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad49f592-5891-42db-ac6f-3ffa726746ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad49f592-5891-42db-ac6f-3ffa726746ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f4ee87aa-4765-4f80-ae65-18849005cba3', 'volume_name': 'volume-f4ee87aa-4765-4f80-ae65-18849005cba3', 'volume_size': 1, 'snapshot_id': '11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17'}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e918252b-4bbb-49fe-9172-da88f985fe79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e918252b-4bbb-49fe-9172-da88f985fe79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (753c186b-eb10-456c-a7c1-c5cd245be477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:02 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Volume f4ee87aa-4765-4f80-ae65-18849005cba3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f4ee87aa-4765-4f80-ae65-18849005cba3', 'volume_size': 1, 'snapshot_id': '11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17'} Sep 28 18:28:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:02 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:28:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Flow 'volume_create_manager' (bdf44bae-a26f-4ec9-90ab-8d31d492da2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (616396b8-417e-4dae-b9a6-d1f2dd36a095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (616396b8-417e-4dae-b9a6-d1f2dd36a095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1515955687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b8595c8-b561-40d0-907f-11a5de281ffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='728a709572704019bd53c7b31b8199e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:02Z,use_quota=True,user_id='c9e6d382da8146a1927ecdfa36f24aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5dd8f9a-7e2b-412a-af35-64d870b82773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5dd8f9a-7e2b-412a-af35-64d870b82773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f37fd8-11ca-4fd7-ab5e-f61fb9eae1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f37fd8-11ca-4fd7-ab5e-f61fb9eae1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b8595c8-b561-40d0-907f-11a5de281ffb', 'volume_name': 'volume-8b8595c8-b561-40d0-907f-11a5de281ffb', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cbcbac9-3f77-440b-b03a-87eed5816941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cbcbac9-3f77-440b-b03a-87eed5816941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04087e4a-16b0-498f-89a5-ec2471272bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:02 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Volume 8b8595c8-b561-40d0-907f-11a5de281ffb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b8595c8-b561-40d0-907f-11a5de281ffb', 'volume_size': 1} Sep 28 18:28:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:02 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7a9c3a67-fcee-4841-93eb-274a87b18b4e 1073741824" returned: 0 in 0.798s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:02 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-420c6901-850e-4143-96d4-3eb1cf3f0bff tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c" returned: 0 in 0.709s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-420c6901-850e-4143-96d4-3eb1cf3f0bff tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7a9c3a67-fcee-4841-93eb-274a87b18b4e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:02 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c Sep 28 18:28:02 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:02 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7a9c3a67-fcee-4841-93eb-274a87b18b4e Sep 28 18:28:02 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:03 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-420c6901-850e-4143-96d4-3eb1cf3f0bff tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7f30d483-0c31-41fa-b81b-cf3c023e787c" returned: 0 in 0.479s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:03 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-420c6901-850e-4143-96d4-3eb1cf3f0bff tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-quobyte-7f30d483-0c31-41fa-b81b-cf3c023e787c" released by "delete_volume" :: held 1.326s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:03 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7a9c3a67-fcee-4841-93eb-274a87b18b4e" returned: 0 in 0.555s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:28:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.594s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1097851703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97fc03e-a3dd-4b46-864d-1f061fa0fa1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='728a709572704019bd53c7b31b8199e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:01Z,use_quota=True,user_id='c9e6d382da8146a1927ecdfa36f24aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:28:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Creating volume c97fc03e-a3dd-4b46-864d-1f061fa0fa1c {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:28:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:28:03 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:28:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c97fc03e-a3dd-4b46-864d-1f061fa0fa1c 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce94d80d-3690-467c-b7fc-7c239ebde35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a9c3a67-fcee-4841-93eb-274a87b18b4e', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (977306dd-01cd-4cfd-bac8-7f17f7aec333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:03 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c97fc03e-a3dd-4b46-864d-1f061fa0fa1c 1073741824 Sep 28 18:28:03 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:03 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Volume volume-7a9c3a67-fcee-4841-93eb-274a87b18b4e (7a9c3a67-fcee-4841-93eb-274a87b18b4e): created successfully Sep 28 18:28:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (977306dd-01cd-4cfd-bac8-7f17f7aec333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Flow 'volume_create_manager' (e50c2184-b352-41d9-917d-ba16e9c7b0e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:03 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-955775a5-3b93-44e9-859c-4656a5f711e5 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Created volume successfully. Sep 28 18:28:03 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-420c6901-850e-4143-96d4-3eb1cf3f0bff tempest-CreateVolumesFromSnapshotTest-1918207090 None] Created reservations ['222c4319-0561-4f78-8c10-a7866570c908', 'd3fc4f13-7893-4c11-a4d2-3f715b47ec70', '5bd46c6f-bb9a-440f-a3c5-0407af41b8b0', 'c8d12098-ab9e-48c7-a561-e17a7f01214c'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-420c6901-850e-4143-96d4-3eb1cf3f0bff tempest-CreateVolumesFromSnapshotTest-1918207090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-420c6901-850e-4143-96d4-3eb1cf3f0bff tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-420c6901-850e-4143-96d4-3eb1cf3f0bff tempest-CreateVolumesFromSnapshotTest-1918207090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-420c6901-850e-4143-96d4-3eb1cf3f0bff tempest-CreateVolumesFromSnapshotTest-1918207090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-420c6901-850e-4143-96d4-3eb1cf3f0bff tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-420c6901-850e-4143-96d4-3eb1cf3f0bff tempest-CreateVolumesFromSnapshotTest-1918207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:03 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:28:03 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:04 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-420c6901-850e-4143-96d4-3eb1cf3f0bff tempest-CreateVolumesFromSnapshotTest-1918207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.618s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:04 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-420c6901-850e-4143-96d4-3eb1cf3f0bff tempest-CreateVolumesFromSnapshotTest-1918207090 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:28:04 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-420c6901-850e-4143-96d4-3eb1cf3f0bff tempest-CreateVolumesFromSnapshotTest-1918207090 None] Deleted volume successfully. Sep 28 18:28:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-420c6901-850e-4143-96d4-3eb1cf3f0bff tempest-CreateVolumesFromSnapshotTest-1918207090 None] Lock "cinder-7f30d483-0c31-41fa-b81b-cf3c023e787c-delete_volume" released by "delete_volume" :: held 2.569s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:04 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c97fc03e-a3dd-4b46-864d-1f061fa0fa1c 1073741824" returned: 0 in 1.178s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c97fc03e-a3dd-4b46-864d-1f061fa0fa1c {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:04 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c97fc03e-a3dd-4b46-864d-1f061fa0fa1c Sep 28 18:28:04 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:28:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:04 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:28:04 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:04 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c97fc03e-a3dd-4b46-864d-1f061fa0fa1c" returned: 0 in 0.430s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:28:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.686s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Acquiring lock "cinder-quobyte-11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17-f4ee87aa-4765-4f80-ae65-18849005cba3" by "_create_volume_from_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08b99f03-b5e8-4d1b-92eb-257b3c4a900a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c97fc03e-a3dd-4b46-864d-1f061fa0fa1c', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b3d8cce-345e-4c51-8cc6-7cdc0fbd59b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Lock "cinder-quobyte-11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17-f4ee87aa-4765-4f80-ae65-18849005cba3" acquired by "_create_volume_from_snapshot" :: waited 0.101s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Creating volume f4ee87aa-4765-4f80-ae65-18849005cba3 from snapshot 11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17 {{(pid=86980) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:28:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:28:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Acquiring lock "cinder-quobyte-f4ee87aa-4765-4f80-ae65-18849005cba3" by "_copy_volume_from_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:05 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Volume volume-c97fc03e-a3dd-4b46-864d-1f061fa0fa1c (c97fc03e-a3dd-4b46-864d-1f061fa0fa1c): created successfully Sep 28 18:28:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b3d8cce-345e-4c51-8cc6-7cdc0fbd59b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Flow 'volume_create_manager' (d4eaaf24-bbda-4ee4-bd10-dd841c99989b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Lock "cinder-quobyte-f4ee87aa-4765-4f80-ae65-18849005cba3" acquired by "_copy_volume_from_snapshot" :: waited 0.085s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] snapshot: 11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17, volume: f4ee87aa-4765-4f80-ae65-18849005cba3, {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:28:05 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-dbd7ee18-4323-4b95-8087-aef20a828587 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Created volume successfully. Sep 28 18:28:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:05 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[806b5e54-639b-48bb-a9f4-44fbd4f82968]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:05 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.654s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:05 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:28:05 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager._thread_info {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:28:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread count: 28 {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:28:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread info: [<_MainThread(MainThread, started 129097393381504)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:28:05 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17 Sep 28 18:28:05 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:05 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17" returned: 0 in 0.600s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9214e6be-f639-4e1a-a709-9036dc43c0c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:28:05 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1441588-ab75-47f7-bcc1-1c93e7b7207d]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:06 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2 Sep 28 18:28:06 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:06 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2" returned: 0 in 0.532s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2 {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:28:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Creating direct copy from snapshot {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:28:06 devstack cinder-volume[86980]: DEBUG cinder.utils [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Path /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f4ee87aa-4765-4f80-ae65-18849005cba3 not found in is_blk_device check {{(pid=86980) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:28:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f4ee87aa-4765-4f80-ae65-18849005cba3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:06 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f4ee87aa-4765-4f80-ae65-18849005cba3 Sep 28 18:28:06 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:14 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f4ee87aa-4765-4f80-ae65-18849005cba3" returned: 0 in 7.760s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:14 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Image conversion details: src /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2, size 1024.00 MB, duration 7.76 sec, destination /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f4ee87aa-4765-4f80-ae65-18849005cba3 {{(pid=86980) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:28:14 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Converted 1024.00 MB image at 131.92 MB/s Sep 28 18:28:14 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f4ee87aa-4765-4f80-ae65-18849005cba3 is being set with open permissions: ugo+rw Sep 28 18:28:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f4ee87aa-4765-4f80-ae65-18849005cba3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:14 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f4ee87aa-4765-4f80-ae65-18849005cba3 Sep 28 18:28:14 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:14 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f4ee87aa-4765-4f80-ae65-18849005cba3" returned: 0 in 0.272s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:14 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Lock "cinder-quobyte-f4ee87aa-4765-4f80-ae65-18849005cba3" released by "_copy_volume_from_snapshot" :: held 9.369s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:16 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Lock "cinder-quobyte-11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17-f4ee87aa-4765-4f80-ae65-18849005cba3" released by "_create_volume_from_snapshot" :: held 11.040s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.144s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.709s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1515955687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b8595c8-b561-40d0-907f-11a5de281ffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='728a709572704019bd53c7b31b8199e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:02Z,use_quota=True,user_id='c9e6d382da8146a1927ecdfa36f24aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:28:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Creating volume 8b8595c8-b561-40d0-907f-11a5de281ffb {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:28:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:28:16 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:28:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8b8595c8-b561-40d0-907f-11a5de281ffb 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:16 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8b8595c8-b561-40d0-907f-11a5de281ffb 1073741824 Sep 28 18:28:16 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:16 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8b8595c8-b561-40d0-907f-11a5de281ffb 1073741824" returned: 0 in 0.428s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (753c186b-eb10-456c-a7c1-c5cd245be477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4ee87aa-4765-4f80-ae65-18849005cba3', 'volume_size': 1, 'snapshot_id': '11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17'}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea29c5e9-ec83-4cb4-80a4-7059dcb8516a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8b8595c8-b561-40d0-907f-11a5de281ffb {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:16 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Volume volume-f4ee87aa-4765-4f80-ae65-18849005cba3 (f4ee87aa-4765-4f80-ae65-18849005cba3): created successfully Sep 28 18:28:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea29c5e9-ec83-4cb4-80a4-7059dcb8516a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:16 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8b8595c8-b561-40d0-907f-11a5de281ffb Sep 28 18:28:16 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:16 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Flow 'volume_create_manager' (56ac99fd-40af-4982-b5b0-79221d69c214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:16 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-16e58e2f-68d9-403d-a0a1-c6f83f39b8b3 tempest-VolumeDependencyTests-564170267 None] Created volume successfully. Sep 28 18:28:16 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8b8595c8-b561-40d0-907f-11a5de281ffb" returned: 0 in 0.332s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:28:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:17 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04087e4a-16b0-498f-89a5-ec2471272bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b8595c8-b561-40d0-907f-11a5de281ffb', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:17 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f05cdbc-7b93-401b-851e-d02e760ed4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:17 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Volume volume-8b8595c8-b561-40d0-907f-11a5de281ffb (8b8595c8-b561-40d0-907f-11a5de281ffb): created successfully Sep 28 18:28:17 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f05cdbc-7b93-401b-851e-d02e760ed4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:17 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Flow 'volume_create_manager' (bdf44bae-a26f-4ec9-90ab-8d31d492da2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:17 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-d768d6d4-c08b-4590-a7a3-08b23478966e tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Created volume successfully. Sep 28 18:28:17 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:28:17 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Flow 'volume_create_manager' (a633cb90-81c4-4808-aef2-e61e81181677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:17 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3231f0d-f39f-417b-9548-d4b845fa02a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:17 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3231f0d-f39f-417b-9548-d4b845fa02a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b27458e-8573-4eff-801a-878764fc7077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82431bf6b7474bb192aed90bce7ff94c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:18Z,use_quota=True,user_id='74cce068e38e4c338aec4b03cd22327a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:17 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc893a1-8b4d-47e5-bba6-1d05c3ad1eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:17 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc893a1-8b4d-47e5-bba6-1d05c3ad1eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:17 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7842b83-a344-4421-ba15-93d61a54e8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:17 devstack cinder-volume[86980]: DEBUG cinder.image.glance [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Creating Keystone auth plugin from conf {{(pid=86980) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-def7957e-20d2-41b7-b754-127f77e4ac78 tempest-VolumeDependencyTests-564170267 None] Acquiring lock "cinder-11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-755f49d0-b26d-4192-bbd9-9e2fc19d77bc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "cinder-8b8595c8-b561-40d0-907f-11a5de281ffb-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-def7957e-20d2-41b7-b754-127f77e4ac78 tempest-VolumeDependencyTests-564170267 None] Lock "cinder-11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-def7957e-20d2-41b7-b754-127f77e4ac78 tempest-VolumeDependencyTests-564170267 None] Acquiring lock "cinder-quobyte-9214e6be-f639-4e1a-a709-9036dc43c0c2" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-def7957e-20d2-41b7-b754-127f77e4ac78 tempest-VolumeDependencyTests-564170267 None] Lock "cinder-quobyte-9214e6be-f639-4e1a-a709-9036dc43c0c2" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-def7957e-20d2-41b7-b754-127f77e4ac78 tempest-VolumeDependencyTests-564170267 None] Acquiring lock "cinder-quobyte-11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-755f49d0-b26d-4192-bbd9-9e2fc19d77bc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "cinder-8b8595c8-b561-40d0-907f-11a5de281ffb-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-def7957e-20d2-41b7-b754-127f77e4ac78 tempest-VolumeDependencyTests-564170267 None] Lock "cinder-quobyte-11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-def7957e-20d2-41b7-b754-127f77e4ac78 tempest-VolumeDependencyTests-564170267 None] Deleting offline snapshot 11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17 of volume 9214e6be-f639-4e1a-a709-9036dc43c0c2 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-def7957e-20d2-41b7-b754-127f77e4ac78 tempest-VolumeDependencyTests-564170267 None] snapshot_file for this snap is: volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f91fa2-c005-4709-9c4a-52d9ff911836]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-def7957e-20d2-41b7-b754-127f77e4ac78 tempest-VolumeDependencyTests-564170267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-755f49d0-b26d-4192-bbd9-9e2fc19d77bc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "cinder-quobyte-8b8595c8-b561-40d0-907f-11a5de281ffb" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-755f49d0-b26d-4192-bbd9-9e2fc19d77bc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "cinder-quobyte-8b8595c8-b561-40d0-907f-11a5de281ffb" acquired by "delete_volume" :: waited 0.020s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1714680-112a-4df9-9d35-c37681b24e7e]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-755f49d0-b26d-4192-bbd9-9e2fc19d77bc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8b8595c8-b561-40d0-907f-11a5de281ffb {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:18 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17 Sep 28 18:28:18 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:18 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8b8595c8-b561-40d0-907f-11a5de281ffb Sep 28 18:28:18 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7842b83-a344-4421-ba15-93d61a54e8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9b27458e-8573-4eff-801a-878764fc7077', 'volume_name': 'volume-9b27458e-8573-4eff-801a-878764fc7077', 'volume_size': 1, 'image_id': '4d77c950-7ff4-4821-a13f-2b1232dceee8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d77c950-7ff4-4821-a13f-2b1232dceee8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc17cd206e0365d40d0a30df90e0a498', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '82431bf6b7474bb192aed90bce7ff94c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2ba075b87c74b57e996c56f3aa6016abae1c37d12b7d444cace8ad07057df27a07d95843cdb8743e644f9fb125a7177cf20d5cb1154b3bde01b2ad8fe1cb975b', 'id': '4d77c950-7ff4-4821-a13f-2b1232dceee8', 'created_at': datetime.datetime(2026, 9, 28, 16, 28, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 28, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d77c950-7ff4-4821-a13f-2b1232dceee8/file', 'properties': {}}, 'image_service': }' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a15c810e-dd64-4f9f-83df-2d5660badac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a15c810e-dd64-4f9f-83df-2d5660badac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (208ed2b0-f75d-41c9-aaf3-00afd9a94392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:18 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Volume 9b27458e-8573-4eff-801a-878764fc7077: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9b27458e-8573-4eff-801a-878764fc7077', 'volume_size': 1, 'image_id': '4d77c950-7ff4-4821-a13f-2b1232dceee8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d77c950-7ff4-4821-a13f-2b1232dceee8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc17cd206e0365d40d0a30df90e0a498', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '82431bf6b7474bb192aed90bce7ff94c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2ba075b87c74b57e996c56f3aa6016abae1c37d12b7d444cace8ad07057df27a07d95843cdb8743e644f9fb125a7177cf20d5cb1154b3bde01b2ad8fe1cb975b', 'id': '4d77c950-7ff4-4821-a13f-2b1232dceee8', 'created_at': datetime.datetime(2026, 9, 28, 16, 28, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 28, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d77c950-7ff4-4821-a13f-2b1232dceee8/file', 'properties': {}}, 'image_service': } Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Trying to clone 9b27458e-8573-4eff-801a-878764fc7077 from image 4d77c950-7ff4-4821-a13f-2b1232dceee8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4d77c950-7ff4-4821-a13f-2b1232dceee8', 'metadata': {}}]). {{(pid=86980) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4d77c950-7ff4-4821-a13f-2b1232dceee8_9vjsmhs0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 18:28:18 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Image download 0.00 MB at 0.00 MB/s Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdb9119-0e90-47fc-b255-f82125feddf6]: (4, 'raw') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d77c950-7ff4-4821-a13f-2b1232dceee8_9vjsmhs0devstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:18 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-def7957e-20d2-41b7-b754-127f77e4ac78 tempest-VolumeDependencyTests-564170267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17" returned: 0 in 0.654s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-def7957e-20d2-41b7-b754-127f77e4ac78 tempest-VolumeDependencyTests-564170267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9214e6be-f639-4e1a-a709-9036dc43c0c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1185749-8264-4eb6-8176-5f406d0dcfdd]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-def7957e-20d2-41b7-b754-127f77e4ac78 tempest-VolumeDependencyTests-564170267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:18 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-755f49d0-b26d-4192-bbd9-9e2fc19d77bc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8b8595c8-b561-40d0-907f-11a5de281ffb" returned: 0 in 0.624s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-755f49d0-b26d-4192-bbd9-9e2fc19d77bc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8b8595c8-b561-40d0-907f-11a5de281ffb {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:18 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d77c950-7ff4-4821-a13f-2b1232dceee8_9vjsmhs0devstack@QuobyteHD Sep 28 18:28:18 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8b8595c8-b561-40d0-907f-11a5de281ffb Sep 28 18:28:18 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:18 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:19 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2 Sep 28 18:28:19 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:19 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-755f49d0-b26d-4192-bbd9-9e2fc19d77bc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8b8595c8-b561-40d0-907f-11a5de281ffb" returned: 0 in 0.312s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:19 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:19 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-755f49d0-b26d-4192-bbd9-9e2fc19d77bc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "cinder-quobyte-8b8595c8-b561-40d0-907f-11a5de281ffb" released by "delete_volume" :: held 1.027s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d77c950-7ff4-4821-a13f-2b1232dceee8_9vjsmhs0devstack@QuobyteHD" returned: 0 in 0.477s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d77c950-7ff4-4821-a13f-2b1232dceee8_9vjsmhs0devstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:19 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-755f49d0-b26d-4192-bbd9-9e2fc19d77bc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Created reservations ['64900e61-99eb-40b5-930a-07d3d8f3ec80', '7868b229-de47-48d4-9152-7419313d53eb', 'f34cd1ba-5577-44cf-8b0e-bd975a1bd787', 'c7d509c0-407b-44d9-ba84-db8cc74da058'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:19 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d77c950-7ff4-4821-a13f-2b1232dceee8_9vjsmhs0devstack@QuobyteHD Sep 28 18:28:19 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:19 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=127,cinder:UPDATE=176,cinder:INSERT=40,cinder:DELETE=11 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:28:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-755f49d0-b26d-4192-bbd9-9e2fc19d77bc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-755f49d0-b26d-4192-bbd9-9e2fc19d77bc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-755f49d0-b26d-4192-bbd9-9e2fc19d77bc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-755f49d0-b26d-4192-bbd9-9e2fc19d77bc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-755f49d0-b26d-4192-bbd9-9e2fc19d77bc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-755f49d0-b26d-4192-bbd9-9e2fc19d77bc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:19 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:28:19 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:19 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-def7957e-20d2-41b7-b754-127f77e4ac78 tempest-VolumeDependencyTests-564170267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2" returned: 0 in 0.756s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-def7957e-20d2-41b7-b754-127f77e4ac78 tempest-VolumeDependencyTests-564170267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:19 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17 Sep 28 18:28:19 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:19 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d77c950-7ff4-4821-a13f-2b1232dceee8_9vjsmhs0devstack@QuobyteHD" returned: 1 in 0.484s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d77c950-7ff4-4821-a13f-2b1232dceee8_9vjsmhs0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:28:19 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Temporary image 4d77c950-7ff4-4821-a13f-2b1232dceee8 is fetched for user 74cce068e38e4c338aec4b03cd22327a. {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 18:28:19 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-755f49d0-b26d-4192-bbd9-9e2fc19d77bc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.301s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:19 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-755f49d0-b26d-4192-bbd9-9e2fc19d77bc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:28:19 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-755f49d0-b26d-4192-bbd9-9e2fc19d77bc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Deleted volume successfully. Sep 28 18:28:19 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-755f49d0-b26d-4192-bbd9-9e2fc19d77bc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "cinder-8b8595c8-b561-40d0-907f-11a5de281ffb-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:19 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:UPDATE=174,cinder:SELECT=127,cinder:DELETE=23,cinder:INSERT=48 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:28:19 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfae8a74-925b-4d01-a119-2527a0fd07c7]: (4, 'raw') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d77c950-7ff4-4821-a13f-2b1232dceee8_9vjsmhs0devstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:20 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d77c950-7ff4-4821-a13f-2b1232dceee8_9vjsmhs0devstack@QuobyteHD Sep 28 18:28:20 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:20 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-def7957e-20d2-41b7-b754-127f77e4ac78 tempest-VolumeDependencyTests-564170267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17" returned: 0 in 0.520s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-def7957e-20d2-41b7-b754-127f77e4ac78 tempest-VolumeDependencyTests-564170267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:20 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17 Sep 28 18:28:20 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:20 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d77c950-7ff4-4821-a13f-2b1232dceee8_9vjsmhs0devstack@QuobyteHD" returned: 0 in 0.411s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d77c950-7ff4-4821-a13f-2b1232dceee8_9vjsmhs0devstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:20 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-8e9f0ac4-cc90-4997-9f35-ea6855166edc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "cinder-c97fc03e-a3dd-4b46-864d-1f061fa0fa1c-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:20 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-8e9f0ac4-cc90-4997-9f35-ea6855166edc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "cinder-c97fc03e-a3dd-4b46-864d-1f061fa0fa1c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:20 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-8e9f0ac4-cc90-4997-9f35-ea6855166edc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "cinder-quobyte-c97fc03e-a3dd-4b46-864d-1f061fa0fa1c" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:20 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-8e9f0ac4-cc90-4997-9f35-ea6855166edc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "cinder-quobyte-c97fc03e-a3dd-4b46-864d-1f061fa0fa1c" acquired by "delete_volume" :: waited 0.024s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:20 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d77c950-7ff4-4821-a13f-2b1232dceee8_9vjsmhs0devstack@QuobyteHD Sep 28 18:28:20 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:20 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-def7957e-20d2-41b7-b754-127f77e4ac78 tempest-VolumeDependencyTests-564170267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2.11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17" returned: 0 in 0.379s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:20 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d7d39b-b9a4-494f-9af8-3aa66e9a348a]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8e9f0ac4-cc90-4997-9f35-ea6855166edc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c97fc03e-a3dd-4b46-864d-1f061fa0fa1c {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:20 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-def7957e-20d2-41b7-b754-127f77e4ac78 tempest-VolumeDependencyTests-564170267 None] Lock "cinder-quobyte-11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17" released by "_delete_snapshot" :: held 2.537s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:20 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-def7957e-20d2-41b7-b754-127f77e4ac78 tempest-VolumeDependencyTests-564170267 None] Lock "cinder-quobyte-9214e6be-f639-4e1a-a709-9036dc43c0c2" released by "delete_snapshot" :: held 2.592s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:20 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c97fc03e-a3dd-4b46-864d-1f061fa0fa1c Sep 28 18:28:20 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:20 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-def7957e-20d2-41b7-b754-127f77e4ac78 tempest-VolumeDependencyTests-564170267 None] Created reservations ['5831bda6-a991-42c6-8cf0-b8a1fc657454', '49ec1f9f-389b-496c-b4f5-02ae329376e7', 'fe398ebd-c6e5-45da-8aae-b73fc8a58234', '592c12a1-313d-4ccd-938d-fb1bef916e2a'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:20 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-def7957e-20d2-41b7-b754-127f77e4ac78 tempest-VolumeDependencyTests-564170267 None] Delete snapshot completed successfully. Sep 28 18:28:20 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-def7957e-20d2-41b7-b754-127f77e4ac78 tempest-VolumeDependencyTests-564170267 None] Lock "cinder-11dfb717-7c5a-47f7-a2fb-3a79cdb6ca17-delete_snapshot" released by "delete_snapshot" :: held 2.790s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:20 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d77c950-7ff4-4821-a13f-2b1232dceee8_9vjsmhs0devstack@QuobyteHD" returned: 1 in 0.563s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d77c950-7ff4-4821-a13f-2b1232dceee8_9vjsmhs0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:28:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:20 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b27458e-8573-4eff-801a-878764fc7077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82431bf6b7474bb192aed90bce7ff94c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:18Z,use_quota=True,user_id='74cce068e38e4c338aec4b03cd22327a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:28:20 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Creating volume 9b27458e-8573-4eff-801a-878764fc7077 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:28:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:20 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:20 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:20 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:28:20 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:28:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b27458e-8573-4eff-801a-878764fc7077 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:20 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b27458e-8573-4eff-801a-878764fc7077 1073741824 Sep 28 18:28:20 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:21 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8e9f0ac4-cc90-4997-9f35-ea6855166edc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c97fc03e-a3dd-4b46-864d-1f061fa0fa1c" returned: 0 in 0.512s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8e9f0ac4-cc90-4997-9f35-ea6855166edc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c97fc03e-a3dd-4b46-864d-1f061fa0fa1c {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:21 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c97fc03e-a3dd-4b46-864d-1f061fa0fa1c Sep 28 18:28:21 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:21 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4d1cd3c4-2832-4d4c-8469-d9f69e3d76b1 tempest-VolumeDependencyTests-564170267 None] Acquiring lock "cinder-9214e6be-f639-4e1a-a709-9036dc43c0c2-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:21 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4d1cd3c4-2832-4d4c-8469-d9f69e3d76b1 tempest-VolumeDependencyTests-564170267 None] Lock "cinder-9214e6be-f639-4e1a-a709-9036dc43c0c2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:21 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4d1cd3c4-2832-4d4c-8469-d9f69e3d76b1 tempest-VolumeDependencyTests-564170267 None] Acquiring lock "cinder-quobyte-9214e6be-f639-4e1a-a709-9036dc43c0c2" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:21 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4d1cd3c4-2832-4d4c-8469-d9f69e3d76b1 tempest-VolumeDependencyTests-564170267 None] Lock "cinder-quobyte-9214e6be-f639-4e1a-a709-9036dc43c0c2" acquired by "delete_volume" :: waited 0.022s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:21 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b641588a-ec7f-45f3-ab7d-4c04b993bb5c]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4d1cd3c4-2832-4d4c-8469-d9f69e3d76b1 tempest-VolumeDependencyTests-564170267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:21 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8e9f0ac4-cc90-4997-9f35-ea6855166edc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c97fc03e-a3dd-4b46-864d-1f061fa0fa1c" returned: 0 in 0.388s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:21 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-8e9f0ac4-cc90-4997-9f35-ea6855166edc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "cinder-quobyte-c97fc03e-a3dd-4b46-864d-1f061fa0fa1c" released by "delete_volume" :: held 0.971s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:21 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b27458e-8573-4eff-801a-878764fc7077 1073741824" returned: 0 in 0.644s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:21 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-8e9f0ac4-cc90-4997-9f35-ea6855166edc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Created reservations ['87338d0b-aa55-456d-9faf-c530c38cbb91', '16085715-f979-4f1c-bc0e-01b0aa9a79c7', 'da4e03e1-7999-424c-8755-1095b31cb72a', '054056e9-64e0-4ad7-aea8-8f42bbc6dc3d'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:21 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2 Sep 28 18:28:21 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b27458e-8573-4eff-801a-878764fc7077 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:21 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b27458e-8573-4eff-801a-878764fc7077 Sep 28 18:28:21 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8e9f0ac4-cc90-4997-9f35-ea6855166edc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8e9f0ac4-cc90-4997-9f35-ea6855166edc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:21 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8e9f0ac4-cc90-4997-9f35-ea6855166edc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:21 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8e9f0ac4-cc90-4997-9f35-ea6855166edc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8e9f0ac4-cc90-4997-9f35-ea6855166edc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8e9f0ac4-cc90-4997-9f35-ea6855166edc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:21 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:28:21 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:21 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b27458e-8573-4eff-801a-878764fc7077" returned: 0 in 0.338s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:21 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:28:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:21 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4d1cd3c4-2832-4d4c-8469-d9f69e3d76b1 tempest-VolumeDependencyTests-564170267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2" returned: 0 in 0.507s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4d1cd3c4-2832-4d4c-8469-d9f69e3d76b1 tempest-VolumeDependencyTests-564170267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:22 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Attempting download of 4d77c950-7ff4-4821-a13f-2b1232dceee8 ((None, [{'url': 'file:///opt/stack/data/glance/images/4d77c950-7ff4-4821-a13f-2b1232dceee8', 'metadata': {}}])) to volume 9b27458e-8573-4eff-801a-878764fc7077. {{(pid=86980) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 18:28:22 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2 Sep 28 18:28:22 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:22 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0b26fd-3c35-45d2-bc3d-f87c99441641]: (4, 'raw') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d77c950-7ff4-4821-a13f-2b1232dceee8_0b9fox6k {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:22 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8e9f0ac4-cc90-4997-9f35-ea6855166edc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.411s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:22 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-8e9f0ac4-cc90-4997-9f35-ea6855166edc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:28:22 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-8e9f0ac4-cc90-4997-9f35-ea6855166edc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Deleted volume successfully. Sep 28 18:28:22 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-8e9f0ac4-cc90-4997-9f35-ea6855166edc tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "cinder-c97fc03e-a3dd-4b46-864d-1f061fa0fa1c-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:22 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d77c950-7ff4-4821-a13f-2b1232dceee8_0b9fox6k Sep 28 18:28:22 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:22 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4d1cd3c4-2832-4d4c-8469-d9f69e3d76b1 tempest-VolumeDependencyTests-564170267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9214e6be-f639-4e1a-a709-9036dc43c0c2" returned: 0 in 0.342s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:22 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4d1cd3c4-2832-4d4c-8469-d9f69e3d76b1 tempest-VolumeDependencyTests-564170267 None] Lock "cinder-quobyte-9214e6be-f639-4e1a-a709-9036dc43c0c2" released by "delete_volume" :: held 0.930s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:22 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-4d1cd3c4-2832-4d4c-8469-d9f69e3d76b1 tempest-VolumeDependencyTests-564170267 None] Created reservations ['4df19767-a0ed-49ae-9714-55d64a99494a', 'c8a318cb-f0db-4f8a-a057-ffe8ccf5c439', 'f95120fa-5158-4d7d-9b7d-2d011b0b0412', 'dde655e0-04ae-4247-93f5-8539ef635121'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4d1cd3c4-2832-4d4c-8469-d9f69e3d76b1 tempest-VolumeDependencyTests-564170267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4d1cd3c4-2832-4d4c-8469-d9f69e3d76b1 tempest-VolumeDependencyTests-564170267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:22 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4d1cd3c4-2832-4d4c-8469-d9f69e3d76b1 tempest-VolumeDependencyTests-564170267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:22 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-4d1cd3c4-2832-4d4c-8469-d9f69e3d76b1 tempest-VolumeDependencyTests-564170267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-4d1cd3c4-2832-4d4c-8469-d9f69e3d76b1 tempest-VolumeDependencyTests-564170267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4d1cd3c4-2832-4d4c-8469-d9f69e3d76b1 tempest-VolumeDependencyTests-564170267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:22 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:28:22 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:22 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d77c950-7ff4-4821-a13f-2b1232dceee8_0b9fox6k" returned: 0 in 0.458s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d77c950-7ff4-4821-a13f-2b1232dceee8_0b9fox6k {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:22 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d77c950-7ff4-4821-a13f-2b1232dceee8_0b9fox6k Sep 28 18:28:22 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:22 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4d1cd3c4-2832-4d4c-8469-d9f69e3d76b1 tempest-VolumeDependencyTests-564170267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.299s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:22 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-4d1cd3c4-2832-4d4c-8469-d9f69e3d76b1 tempest-VolumeDependencyTests-564170267 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:28:22 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-4d1cd3c4-2832-4d4c-8469-d9f69e3d76b1 tempest-VolumeDependencyTests-564170267 None] Deleted volume successfully. Sep 28 18:28:22 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d77c950-7ff4-4821-a13f-2b1232dceee8_0b9fox6k" returned: 1 in 0.372s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d77c950-7ff4-4821-a13f-2b1232dceee8_0b9fox6k' failed. Not Retrying. {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:28:22 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3420db-c00c-44df-bf8b-c6fbdd0a5755]: (4, 'raw') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d77c950-7ff4-4821-a13f-2b1232dceee8_9vjsmhs0devstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4d1cd3c4-2832-4d4c-8469-d9f69e3d76b1 tempest-VolumeDependencyTests-564170267 None] Lock "cinder-9214e6be-f639-4e1a-a709-9036dc43c0c2-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-103e831a-32dd-4bd5-9f10-91b5dd71d379 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "cinder-7a9c3a67-fcee-4841-93eb-274a87b18b4e-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:23 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d77c950-7ff4-4821-a13f-2b1232dceee8_9vjsmhs0devstack@QuobyteHD Sep 28 18:28:23 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-103e831a-32dd-4bd5-9f10-91b5dd71d379 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "cinder-7a9c3a67-fcee-4841-93eb-274a87b18b4e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-103e831a-32dd-4bd5-9f10-91b5dd71d379 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "cinder-quobyte-7a9c3a67-fcee-4841-93eb-274a87b18b4e" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-103e831a-32dd-4bd5-9f10-91b5dd71d379 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "cinder-quobyte-7a9c3a67-fcee-4841-93eb-274a87b18b4e" acquired by "delete_volume" :: waited 0.034s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:23 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[da36f472-9005-41ae-b2bc-d586dd4422c8]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-103e831a-32dd-4bd5-9f10-91b5dd71d379 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7a9c3a67-fcee-4841-93eb-274a87b18b4e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:23 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7a9c3a67-fcee-4841-93eb-274a87b18b4e Sep 28 18:28:23 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:23 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4d77c950-7ff4-4821-a13f-2b1232dceee8_9vjsmhs0devstack@QuobyteHD" returned: 0 in 0.495s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d77c950-7ff4-4821-a13f-2b1232dceee8_9vjsmhs0devstack@QuobyteHD {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-11dccd8e-b9d8-4374-8f3e-4fb52301be0b tempest-VolumeDependencyTests-564170267 None] Acquiring lock "cinder-f4ee87aa-4765-4f80-ae65-18849005cba3-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:23 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d77c950-7ff4-4821-a13f-2b1232dceee8_9vjsmhs0devstack@QuobyteHD Sep 28 18:28:23 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-11dccd8e-b9d8-4374-8f3e-4fb52301be0b tempest-VolumeDependencyTests-564170267 None] Lock "cinder-f4ee87aa-4765-4f80-ae65-18849005cba3-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-11dccd8e-b9d8-4374-8f3e-4fb52301be0b tempest-VolumeDependencyTests-564170267 None] Acquiring lock "cinder-quobyte-f4ee87aa-4765-4f80-ae65-18849005cba3" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-11dccd8e-b9d8-4374-8f3e-4fb52301be0b tempest-VolumeDependencyTests-564170267 None] Lock "cinder-quobyte-f4ee87aa-4765-4f80-ae65-18849005cba3" acquired by "delete_volume" :: waited 0.023s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:23 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eff011a-2909-4824-baa7-683417218a00]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-11dccd8e-b9d8-4374-8f3e-4fb52301be0b tempest-VolumeDependencyTests-564170267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f4ee87aa-4765-4f80-ae65-18849005cba3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:23 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-103e831a-32dd-4bd5-9f10-91b5dd71d379 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7a9c3a67-fcee-4841-93eb-274a87b18b4e" returned: 0 in 0.569s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-103e831a-32dd-4bd5-9f10-91b5dd71d379 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7a9c3a67-fcee-4841-93eb-274a87b18b4e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:23 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:23 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7a9c3a67-fcee-4841-93eb-274a87b18b4e Sep 28 18:28:23 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d77c950-7ff4-4821-a13f-2b1232dceee8_9vjsmhs0devstack@QuobyteHD" returned: 1 in 0.443s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4d77c950-7ff4-4821-a13f-2b1232dceee8_9vjsmhs0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 18:28:23 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] 4d77c950-7ff4-4821-a13f-2b1232dceee8 was raw, converting to qcow2 {{(pid=86980) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 18:28:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4d77c950-7ff4-4821-a13f-2b1232dceee8_9vjsmhs0devstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b27458e-8573-4eff-801a-878764fc7077 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:23 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4d77c950-7ff4-4821-a13f-2b1232dceee8_9vjsmhs0devstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b27458e-8573-4eff-801a-878764fc7077 Sep 28 18:28:23 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:23 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f4ee87aa-4765-4f80-ae65-18849005cba3 Sep 28 18:28:23 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:24 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-103e831a-32dd-4bd5-9f10-91b5dd71d379 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7a9c3a67-fcee-4841-93eb-274a87b18b4e" returned: 0 in 0.357s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:24 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-103e831a-32dd-4bd5-9f10-91b5dd71d379 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "cinder-quobyte-7a9c3a67-fcee-4841-93eb-274a87b18b4e" released by "delete_volume" :: held 1.016s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:24 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-103e831a-32dd-4bd5-9f10-91b5dd71d379 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Created reservations ['9493330c-e508-4c37-a23c-8af3724d1d62', 'afbab35f-7748-4e5f-a07e-097ac25e6fd1', '677f68c7-4cae-431f-9658-f9592b0e56b9', 'df4035c9-42db-43e1-a358-8c6a9144d171'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:24 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-11dccd8e-b9d8-4374-8f3e-4fb52301be0b tempest-VolumeDependencyTests-564170267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f4ee87aa-4765-4f80-ae65-18849005cba3" returned: 0 in 0.660s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-11dccd8e-b9d8-4374-8f3e-4fb52301be0b tempest-VolumeDependencyTests-564170267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f4ee87aa-4765-4f80-ae65-18849005cba3 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:24 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f4ee87aa-4765-4f80-ae65-18849005cba3 Sep 28 18:28:24 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-103e831a-32dd-4bd5-9f10-91b5dd71d379 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-103e831a-32dd-4bd5-9f10-91b5dd71d379 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:24 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-103e831a-32dd-4bd5-9f10-91b5dd71d379 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:24 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-103e831a-32dd-4bd5-9f10-91b5dd71d379 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-103e831a-32dd-4bd5-9f10-91b5dd71d379 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-103e831a-32dd-4bd5-9f10-91b5dd71d379 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:24 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:28:24 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:24 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4d77c950-7ff4-4821-a13f-2b1232dceee8_9vjsmhs0devstack@QuobyteHD /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b27458e-8573-4eff-801a-878764fc7077" returned: 0 in 0.807s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:24 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4d77c950-7ff4-4821-a13f-2b1232dceee8_9vjsmhs0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b27458e-8573-4eff-801a-878764fc7077 {{(pid=86980) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:28:24 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 18:28:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b27458e-8573-4eff-801a-878764fc7077 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:24 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-11dccd8e-b9d8-4374-8f3e-4fb52301be0b tempest-VolumeDependencyTests-564170267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-f4ee87aa-4765-4f80-ae65-18849005cba3" returned: 0 in 0.339s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:24 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b27458e-8573-4eff-801a-878764fc7077 1G Sep 28 18:28:24 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:24 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-11dccd8e-b9d8-4374-8f3e-4fb52301be0b tempest-VolumeDependencyTests-564170267 None] Lock "cinder-quobyte-f4ee87aa-4765-4f80-ae65-18849005cba3" released by "delete_volume" :: held 1.064s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:24 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-103e831a-32dd-4bd5-9f10-91b5dd71d379 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.337s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:24 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-103e831a-32dd-4bd5-9f10-91b5dd71d379 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:28:24 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-103e831a-32dd-4bd5-9f10-91b5dd71d379 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Deleted volume successfully. Sep 28 18:28:24 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-11dccd8e-b9d8-4374-8f3e-4fb52301be0b tempest-VolumeDependencyTests-564170267 None] Created reservations ['3696de51-507c-473f-9e85-e7374055feea', '1694066b-6f5c-47de-89a8-c96d223e49de', '9980c253-110a-4d42-b17f-2f95d0497bbf', 'fbcbff57-0428-4c5e-8d05-962430a0a39a'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:24 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-103e831a-32dd-4bd5-9f10-91b5dd71d379 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "cinder-7a9c3a67-fcee-4841-93eb-274a87b18b4e-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-11dccd8e-b9d8-4374-8f3e-4fb52301be0b tempest-VolumeDependencyTests-564170267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-11dccd8e-b9d8-4374-8f3e-4fb52301be0b tempest-VolumeDependencyTests-564170267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:24 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-11dccd8e-b9d8-4374-8f3e-4fb52301be0b tempest-VolumeDependencyTests-564170267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:24 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-11dccd8e-b9d8-4374-8f3e-4fb52301be0b tempest-VolumeDependencyTests-564170267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-11dccd8e-b9d8-4374-8f3e-4fb52301be0b tempest-VolumeDependencyTests-564170267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-11dccd8e-b9d8-4374-8f3e-4fb52301be0b tempest-VolumeDependencyTests-564170267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:25 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:28:25 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:25 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b27458e-8573-4eff-801a-878764fc7077 1G" returned: 0 in 0.515s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:25 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Downloaded image 4d77c950-7ff4-4821-a13f-2b1232dceee8 ((None, [{'url': 'file:///opt/stack/data/glance/images/4d77c950-7ff4-4821-a13f-2b1232dceee8', 'metadata': {}}])) to volume 9b27458e-8573-4eff-801a-878764fc7077 successfully. {{(pid=86980) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 18:28:25 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Temporary image 4d77c950-7ff4-4821-a13f-2b1232dceee8 for user 74cce068e38e4c338aec4b03cd22327a is deleted. {{(pid=86980) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 18:28:25 devstack cinder-volume[86980]: DEBUG cinder.volume.volume_utils [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Marking volume 9b27458e-8573-4eff-801a-878764fc7077 as bootable. {{(pid=86980) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 18:28:25 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Copying metadata from image 4d77c950-7ff4-4821-a13f-2b1232dceee8 to 9b27458e-8573-4eff-801a-878764fc7077. {{(pid=86980) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 18:28:25 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Creating volume glance metadata for volume 9b27458e-8573-4eff-801a-878764fc7077 backed by image 4d77c950-7ff4-4821-a13f-2b1232dceee8 with: {'image_id': '4d77c950-7ff4-4821-a13f-2b1232dceee8', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'fc17cd206e0365d40d0a30df90e0a498', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86980) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 18:28:25 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-11dccd8e-b9d8-4374-8f3e-4fb52301be0b tempest-VolumeDependencyTests-564170267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.336s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:25 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-11dccd8e-b9d8-4374-8f3e-4fb52301be0b tempest-VolumeDependencyTests-564170267 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:28:25 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-11dccd8e-b9d8-4374-8f3e-4fb52301be0b tempest-VolumeDependencyTests-564170267 None] Deleted volume successfully. Sep 28 18:28:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (208ed2b0-f75d-41c9-aaf3-00afd9a94392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b27458e-8573-4eff-801a-878764fc7077', 'volume_size': 1, 'image_id': '4d77c950-7ff4-4821-a13f-2b1232dceee8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d77c950-7ff4-4821-a13f-2b1232dceee8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc17cd206e0365d40d0a30df90e0a498', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '82431bf6b7474bb192aed90bce7ff94c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2ba075b87c74b57e996c56f3aa6016abae1c37d12b7d444cace8ad07057df27a07d95843cdb8743e644f9fb125a7177cf20d5cb1154b3bde01b2ad8fe1cb975b', 'id': '4d77c950-7ff4-4821-a13f-2b1232dceee8', 'created_at': datetime.datetime(2026, 9, 28, 16, 28, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 16, 28, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d77c950-7ff4-4821-a13f-2b1232dceee8/file', 'properties': {}}, 'image_service': }' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11889792-376e-4ade-a922-3718f767e445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:25 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-11dccd8e-b9d8-4374-8f3e-4fb52301be0b tempest-VolumeDependencyTests-564170267 None] Lock "cinder-f4ee87aa-4765-4f80-ae65-18849005cba3-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:25 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Volume volume-9b27458e-8573-4eff-801a-878764fc7077 (9b27458e-8573-4eff-801a-878764fc7077): created successfully Sep 28 18:28:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11889792-376e-4ade-a922-3718f767e445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Flow 'volume_create_manager' (a633cb90-81c4-4808-aef2-e61e81181677) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:25 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-2bc415c7-5fe6-478b-ba63-0938f5ceb0aa tempest-VolumeImageDependencyTests-82817351 None] Created volume successfully. Sep 28 18:28:25 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a990ea41-401e-4e8e-9884-523cef642679 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "cinder-2a8f6839-a1d1-4c09-adc9-98e85c64b58f-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:25 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a990ea41-401e-4e8e-9884-523cef642679 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "cinder-2a8f6839-a1d1-4c09-adc9-98e85c64b58f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:25 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a990ea41-401e-4e8e-9884-523cef642679 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "cinder-quobyte-2a8f6839-a1d1-4c09-adc9-98e85c64b58f" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:25 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a990ea41-401e-4e8e-9884-523cef642679 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "cinder-quobyte-2a8f6839-a1d1-4c09-adc9-98e85c64b58f" acquired by "delete_volume" :: waited 0.017s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:25 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8ccd35-1d3a-4dbb-8475-4dd35450ea0a]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a990ea41-401e-4e8e-9884-523cef642679 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a8f6839-a1d1-4c09-adc9-98e85c64b58f {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:25 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-85ab8811-bd24-4cfe-b5c9-83750db40def tempest-VolumeImageDependencyTests-82817351 None] Acquiring lock "cinder-9b27458e-8573-4eff-801a-878764fc7077-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:25 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-85ab8811-bd24-4cfe-b5c9-83750db40def tempest-VolumeImageDependencyTests-82817351 None] Lock "cinder-9b27458e-8573-4eff-801a-878764fc7077-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:25 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a8f6839-a1d1-4c09-adc9-98e85c64b58f Sep 28 18:28:25 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:25 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-85ab8811-bd24-4cfe-b5c9-83750db40def tempest-VolumeImageDependencyTests-82817351 None] Acquiring lock "cinder-quobyte-9b27458e-8573-4eff-801a-878764fc7077" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:25 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-85ab8811-bd24-4cfe-b5c9-83750db40def tempest-VolumeImageDependencyTests-82817351 None] Lock "cinder-quobyte-9b27458e-8573-4eff-801a-878764fc7077" acquired by "delete_volume" :: waited 0.036s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:25 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbbb4a5-815e-4f7b-b0ae-7eb2eba5bdbb]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-85ab8811-bd24-4cfe-b5c9-83750db40def tempest-VolumeImageDependencyTests-82817351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b27458e-8573-4eff-801a-878764fc7077 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:26 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b27458e-8573-4eff-801a-878764fc7077 Sep 28 18:28:26 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:26 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a990ea41-401e-4e8e-9884-523cef642679 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a8f6839-a1d1-4c09-adc9-98e85c64b58f" returned: 0 in 0.612s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a990ea41-401e-4e8e-9884-523cef642679 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a8f6839-a1d1-4c09-adc9-98e85c64b58f {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:26 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a8f6839-a1d1-4c09-adc9-98e85c64b58f Sep 28 18:28:26 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:26 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-85ab8811-bd24-4cfe-b5c9-83750db40def tempest-VolumeImageDependencyTests-82817351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b27458e-8573-4eff-801a-878764fc7077" returned: 0 in 0.484s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-85ab8811-bd24-4cfe-b5c9-83750db40def tempest-VolumeImageDependencyTests-82817351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b27458e-8573-4eff-801a-878764fc7077 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:26 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b27458e-8573-4eff-801a-878764fc7077 Sep 28 18:28:26 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:26 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a990ea41-401e-4e8e-9884-523cef642679 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2a8f6839-a1d1-4c09-adc9-98e85c64b58f" returned: 0 in 0.429s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:26 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a990ea41-401e-4e8e-9884-523cef642679 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "cinder-quobyte-2a8f6839-a1d1-4c09-adc9-98e85c64b58f" released by "delete_volume" :: held 1.132s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:26 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:26 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-a990ea41-401e-4e8e-9884-523cef642679 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Created reservations ['9b2c4412-1a75-4611-9780-b394f60ab975', 'd82613c3-26d7-42ba-8f26-8e1f9b480e6b', '2598e294-3c17-46dc-ad5a-8a8e6a248436', 'a6958af1-b237-4792-8264-a6f3164bbf43'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-85ab8811-bd24-4cfe-b5c9-83750db40def tempest-VolumeImageDependencyTests-82817351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-9b27458e-8573-4eff-801a-878764fc7077" returned: 0 in 0.419s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:26 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-85ab8811-bd24-4cfe-b5c9-83750db40def tempest-VolumeImageDependencyTests-82817351 None] Lock "cinder-quobyte-9b27458e-8573-4eff-801a-878764fc7077" released by "delete_volume" :: held 1.015s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a990ea41-401e-4e8e-9884-523cef642679 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a990ea41-401e-4e8e-9884-523cef642679 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a990ea41-401e-4e8e-9884-523cef642679 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a990ea41-401e-4e8e-9884-523cef642679 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a990ea41-401e-4e8e-9884-523cef642679 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a990ea41-401e-4e8e-9884-523cef642679 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:27 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-85ab8811-bd24-4cfe-b5c9-83750db40def tempest-VolumeImageDependencyTests-82817351 None] Created reservations ['dfbfb843-2393-45bf-8c1e-f86f1d971144', '55a35b5b-a416-4024-87c0-ee73a03ac6cc', 'b7c70cf4-7c2f-4bce-bd69-5839badf28fd', '3fc20b73-ed13-42fc-adac-48632fae5297'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:27 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:28:27 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-85ab8811-bd24-4cfe-b5c9-83750db40def tempest-VolumeImageDependencyTests-82817351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-85ab8811-bd24-4cfe-b5c9-83750db40def tempest-VolumeImageDependencyTests-82817351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-85ab8811-bd24-4cfe-b5c9-83750db40def tempest-VolumeImageDependencyTests-82817351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-85ab8811-bd24-4cfe-b5c9-83750db40def tempest-VolumeImageDependencyTests-82817351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-85ab8811-bd24-4cfe-b5c9-83750db40def tempest-VolumeImageDependencyTests-82817351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-85ab8811-bd24-4cfe-b5c9-83750db40def tempest-VolumeImageDependencyTests-82817351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:27 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:28:27 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:27 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a990ea41-401e-4e8e-9884-523cef642679 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.408s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:27 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-a990ea41-401e-4e8e-9884-523cef642679 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:28:27 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-a990ea41-401e-4e8e-9884-523cef642679 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Deleted volume successfully. Sep 28 18:28:27 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-a990ea41-401e-4e8e-9884-523cef642679 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "cinder-2a8f6839-a1d1-4c09-adc9-98e85c64b58f-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:27 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-85ab8811-bd24-4cfe-b5c9-83750db40def tempest-VolumeImageDependencyTests-82817351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.319s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:27 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-85ab8811-bd24-4cfe-b5c9-83750db40def tempest-VolumeImageDependencyTests-82817351 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:28:27 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-85ab8811-bd24-4cfe-b5c9-83750db40def tempest-VolumeImageDependencyTests-82817351 None] Deleted volume successfully. Sep 28 18:28:27 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-85ab8811-bd24-4cfe-b5c9-83750db40def tempest-VolumeImageDependencyTests-82817351 None] Lock "cinder-9b27458e-8573-4eff-801a-878764fc7077-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:27 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-50071535-8113-4a5a-9680-04c72aeb0ca6 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "cinder-5021bf1d-b659-428e-931c-f4f23ee8b350-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:27 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-50071535-8113-4a5a-9680-04c72aeb0ca6 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "cinder-5021bf1d-b659-428e-931c-f4f23ee8b350-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:27 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-50071535-8113-4a5a-9680-04c72aeb0ca6 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "cinder-quobyte-5021bf1d-b659-428e-931c-f4f23ee8b350" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:27 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-50071535-8113-4a5a-9680-04c72aeb0ca6 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "cinder-quobyte-5021bf1d-b659-428e-931c-f4f23ee8b350" acquired by "delete_volume" :: waited 0.021s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:28 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d08628f-247d-4d52-8392-0f607517d17a]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-50071535-8113-4a5a-9680-04c72aeb0ca6 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5021bf1d-b659-428e-931c-f4f23ee8b350 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:28 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5021bf1d-b659-428e-931c-f4f23ee8b350 Sep 28 18:28:28 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:28 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-50071535-8113-4a5a-9680-04c72aeb0ca6 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5021bf1d-b659-428e-931c-f4f23ee8b350" returned: 0 in 0.549s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-50071535-8113-4a5a-9680-04c72aeb0ca6 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5021bf1d-b659-428e-931c-f4f23ee8b350 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:28 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5021bf1d-b659-428e-931c-f4f23ee8b350 Sep 28 18:28:28 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:28 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-50071535-8113-4a5a-9680-04c72aeb0ca6 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5021bf1d-b659-428e-931c-f4f23ee8b350" returned: 0 in 0.374s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:28 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-50071535-8113-4a5a-9680-04c72aeb0ca6 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "cinder-quobyte-5021bf1d-b659-428e-931c-f4f23ee8b350" released by "delete_volume" :: held 1.010s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:29 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-50071535-8113-4a5a-9680-04c72aeb0ca6 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Created reservations ['5074649a-c598-45c6-bb65-e3847d5abccc', 'c8dd0eb3-e730-4ca9-8012-f829c9587b19', '30bc1b78-aa88-4748-85df-0a008f7f7e11', 'fc32e48f-de0d-4e83-a726-be617755c447'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-50071535-8113-4a5a-9680-04c72aeb0ca6 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-50071535-8113-4a5a-9680-04c72aeb0ca6 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-50071535-8113-4a5a-9680-04c72aeb0ca6 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-50071535-8113-4a5a-9680-04c72aeb0ca6 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-50071535-8113-4a5a-9680-04c72aeb0ca6 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-50071535-8113-4a5a-9680-04c72aeb0ca6 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:29 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:28:29 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:29 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-50071535-8113-4a5a-9680-04c72aeb0ca6 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.341s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:29 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-50071535-8113-4a5a-9680-04c72aeb0ca6 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:28:29 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-50071535-8113-4a5a-9680-04c72aeb0ca6 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Deleted volume successfully. Sep 28 18:28:29 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-50071535-8113-4a5a-9680-04c72aeb0ca6 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "cinder-5021bf1d-b659-428e-931c-f4f23ee8b350-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:30 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-542cda2d-2ec8-4648-acdf-db329d8dd641 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "cinder-5bc2d273-ec91-46d1-9a90-c356a2406f66-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:30 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-542cda2d-2ec8-4648-acdf-db329d8dd641 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "cinder-5bc2d273-ec91-46d1-9a90-c356a2406f66-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:30 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-542cda2d-2ec8-4648-acdf-db329d8dd641 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "cinder-quobyte-5bc2d273-ec91-46d1-9a90-c356a2406f66" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:30 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-542cda2d-2ec8-4648-acdf-db329d8dd641 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "cinder-quobyte-5bc2d273-ec91-46d1-9a90-c356a2406f66" acquired by "delete_volume" :: waited 0.026s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:30 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf6d88b-1cc0-493b-8a13-89b1aae10ad4]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-542cda2d-2ec8-4648-acdf-db329d8dd641 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5bc2d273-ec91-46d1-9a90-c356a2406f66 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:30 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5bc2d273-ec91-46d1-9a90-c356a2406f66 Sep 28 18:28:30 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:30 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-542cda2d-2ec8-4648-acdf-db329d8dd641 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5bc2d273-ec91-46d1-9a90-c356a2406f66" returned: 0 in 0.606s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-542cda2d-2ec8-4648-acdf-db329d8dd641 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5bc2d273-ec91-46d1-9a90-c356a2406f66 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:31 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5bc2d273-ec91-46d1-9a90-c356a2406f66 Sep 28 18:28:31 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:31 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-542cda2d-2ec8-4648-acdf-db329d8dd641 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-5bc2d273-ec91-46d1-9a90-c356a2406f66" returned: 0 in 0.368s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:31 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-542cda2d-2ec8-4648-acdf-db329d8dd641 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "cinder-quobyte-5bc2d273-ec91-46d1-9a90-c356a2406f66" released by "delete_volume" :: held 1.069s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:31 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-542cda2d-2ec8-4648-acdf-db329d8dd641 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Created reservations ['d459dd04-731c-4f9a-bc4d-862990674655', 'd6fb308f-63cf-42ea-a757-7ee231dee7fc', 'aaf3331f-60fa-415b-8c43-1ac7f64f7713', 'f26dd104-d4f1-4dc4-a93b-52dbcac73f0f'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-542cda2d-2ec8-4648-acdf-db329d8dd641 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-542cda2d-2ec8-4648-acdf-db329d8dd641 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:31 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-542cda2d-2ec8-4648-acdf-db329d8dd641 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:31 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-542cda2d-2ec8-4648-acdf-db329d8dd641 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-542cda2d-2ec8-4648-acdf-db329d8dd641 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-542cda2d-2ec8-4648-acdf-db329d8dd641 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:31 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:28:31 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:32 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-542cda2d-2ec8-4648-acdf-db329d8dd641 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.358s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:32 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-542cda2d-2ec8-4648-acdf-db329d8dd641 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:28:32 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-542cda2d-2ec8-4648-acdf-db329d8dd641 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Deleted volume successfully. Sep 28 18:28:32 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-542cda2d-2ec8-4648-acdf-db329d8dd641 tempest-CreateVolumesFromSourceVolumeTest-417480674 None] Lock "cinder-5bc2d273-ec91-46d1-9a90-c356a2406f66-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:32 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:28:32 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Flow 'volume_create_manager' (9a910e85-1f6e-4ad6-8cce-a08dbefa60f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:32 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd258ca-2d02-4556-99ad-1a80417f2546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:32 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd258ca-2d02-4556-99ad-1a80417f2546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d2ad0f-17a3-4613-8299-14de09d97740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4beb07d1bd094535a84c4de02f016919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:32Z,use_quota=True,user_id='1715858698fd4ab987891d27193361b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:32 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ff11798-6473-4c85-84d8-8b00e7e2bfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:32 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ff11798-6473-4c85-84d8-8b00e7e2bfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:32 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1e7681-6bc9-4ecc-a044-ca93a55be5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:32 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1e7681-6bc9-4ecc-a044-ca93a55be5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10d2ad0f-17a3-4613-8299-14de09d97740', 'volume_name': 'volume-10d2ad0f-17a3-4613-8299-14de09d97740', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:32 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a813f8e-1815-4b33-8783-d0a1516a6fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:32 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a813f8e-1815-4b33-8783-d0a1516a6fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:32 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e745d9-847a-456d-b850-bf5b45945bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:32 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Volume 10d2ad0f-17a3-4613-8299-14de09d97740: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10d2ad0f-17a3-4613-8299-14de09d97740', 'volume_size': 1} Sep 28 18:28:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:32 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d2ad0f-17a3-4613-8299-14de09d97740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4beb07d1bd094535a84c4de02f016919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:32Z,use_quota=True,user_id='1715858698fd4ab987891d27193361b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:28:32 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Creating volume 10d2ad0f-17a3-4613-8299-14de09d97740 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:28:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:32 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:32 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:32 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:28:32 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:28:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-10d2ad0f-17a3-4613-8299-14de09d97740 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:32 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-10d2ad0f-17a3-4613-8299-14de09d97740 1073741824 Sep 28 18:28:32 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:33 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-10d2ad0f-17a3-4613-8299-14de09d97740 1073741824" returned: 0 in 0.710s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-10d2ad0f-17a3-4613-8299-14de09d97740 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:33 devstack sudo[108022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-10d2ad0f-17a3-4613-8299-14de09d97740 Sep 28 18:28:33 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:33 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-10d2ad0f-17a3-4613-8299-14de09d97740" returned: 0 in 0.380s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:28:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e745d9-847a-456d-b850-bf5b45945bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10d2ad0f-17a3-4613-8299-14de09d97740', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74b0345-abfe-453f-89fb-5bc65cc96888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:33 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Volume volume-10d2ad0f-17a3-4613-8299-14de09d97740 (10d2ad0f-17a3-4613-8299-14de09d97740): created successfully Sep 28 18:28:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74b0345-abfe-453f-89fb-5bc65cc96888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Flow 'volume_create_manager' (9a910e85-1f6e-4ad6-8cce-a08dbefa60f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:33 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:28:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Flow 'volume_create_manager' (bb99fa73-b2e3-4c9e-b607-a131572d7c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ff7012-6544-4ca4-a348-6339f75d5ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:33 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-5af71e95-2b71-4634-85c1-496983a2fba7 tempest-CinderUnicodeTest-519549991 None] Created volume successfully. Sep 28 18:28:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ff7012-6544-4ca4-a348-6339f75d5ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1647076329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea50356d-0f63-4993-a5df-52bd54685d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ce4b7227db4814b4110a415a2a26db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:34Z,use_quota=True,user_id='b8822b75f395415890ecdbd08c5250af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a5c59e-a5a3-4475-830f-8c2eb57ec75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a5c59e-a5a3-4475-830f-8c2eb57ec75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b1ee93c-a68e-440a-b52a-e9e5061e1ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:33 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b1ee93c-a68e-440a-b52a-e9e5061e1ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea50356d-0f63-4993-a5df-52bd54685d70', 'volume_name': 'volume-ea50356d-0f63-4993-a5df-52bd54685d70', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:34 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01cc4e09-2d49-4abc-9bed-86ad7b9d463a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:34 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01cc4e09-2d49-4abc-9bed-86ad7b9d463a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:34 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad295b28-7b01-475c-aefc-374a1f62a484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:34 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Volume ea50356d-0f63-4993-a5df-52bd54685d70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea50356d-0f63-4993-a5df-52bd54685d70', 'volume_size': 1} Sep 28 18:28:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:34 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1647076329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea50356d-0f63-4993-a5df-52bd54685d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ce4b7227db4814b4110a415a2a26db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:34Z,use_quota=True,user_id='b8822b75f395415890ecdbd08c5250af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:28:34 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Creating volume ea50356d-0f63-4993-a5df-52bd54685d70 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:28:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:34 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:34 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:34 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:28:34 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:28:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:34 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70 1073741824 Sep 28 18:28:34 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:34 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70 1073741824" returned: 0 in 0.578s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:34 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70 Sep 28 18:28:34 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:35 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70" returned: 0 in 0.471s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:35 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:28:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad295b28-7b01-475c-aefc-374a1f62a484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea50356d-0f63-4993-a5df-52bd54685d70', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7188de6d-0269-48a6-9ca7-a4d4927be723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:35 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Volume volume-ea50356d-0f63-4993-a5df-52bd54685d70 (ea50356d-0f63-4993-a5df-52bd54685d70): created successfully Sep 28 18:28:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7188de6d-0269-48a6-9ca7-a4d4927be723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Flow 'volume_create_manager' (bb99fa73-b2e3-4c9e-b607-a131572d7c45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:35 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-2c57d705-4578-4527-9265-3f03d5fc75ac tempest-SnapshotDependencyTests-1963002193 None] Created volume successfully. Sep 28 18:28:35 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:28:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Flow 'volume_create_manager' (4743082e-0f1b-4275-b1af-4f4f45f6ad6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0445d71-9a18-4e84-9551-f02e34e2dea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0445d71-9a18-4e84-9551-f02e34e2dea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1642641591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=215db083-9e90-4472-9d3c-6bf807f7107d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4beb07d1bd094535a84c4de02f016919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:36Z,use_quota=True,user_id='1715858698fd4ab987891d27193361b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ab2b7d2-083f-4685-9650-e465c186a107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ab2b7d2-083f-4685-9650-e465c186a107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59767a8e-4bfb-4144-8904-38640aaf4d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59767a8e-4bfb-4144-8904-38640aaf4d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '215db083-9e90-4472-9d3c-6bf807f7107d', 'volume_name': 'volume-215db083-9e90-4472-9d3c-6bf807f7107d', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99ff94f-6221-4776-ae0a-ad191de39685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99ff94f-6221-4776-ae0a-ad191de39685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:35 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7073eda-716e-49b4-b77f-f509e14f06ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:35 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Volume 215db083-9e90-4472-9d3c-6bf807f7107d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-215db083-9e90-4472-9d3c-6bf807f7107d', 'volume_size': 1} Sep 28 18:28:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:35 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1642641591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=215db083-9e90-4472-9d3c-6bf807f7107d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4beb07d1bd094535a84c4de02f016919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:36Z,use_quota=True,user_id='1715858698fd4ab987891d27193361b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:28:35 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Creating volume 215db083-9e90-4472-9d3c-6bf807f7107d {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:28:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:35 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:35 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:35 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:28:35 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:28:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:35 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d 1073741824 Sep 28 18:28:35 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-fc252d01-3aef-4f12-a19a-59db8039321a tempest-SnapshotDependencyTests-1963002193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:36 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d 1073741824" returned: 0 in 0.697s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:36 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d Sep 28 18:28:36 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:36 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d" returned: 0 in 0.345s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:28:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-fc252d01-3aef-4f12-a19a-59db8039321a tempest-SnapshotDependencyTests-1963002193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.507s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7073eda-716e-49b4-b77f-f509e14f06ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-215db083-9e90-4472-9d3c-6bf807f7107d', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c2a6e44-9655-47da-a00e-f3ddf9d3c4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-fc252d01-3aef-4f12-a19a-59db8039321a tempest-SnapshotDependencyTests-1963002193 None] Creating offline snapshot d65d4132-8470-423e-8dd8-315835189073 of volume ea50356d-0f63-4993-a5df-52bd54685d70 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:28:36 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Volume volume-215db083-9e90-4472-9d3c-6bf807f7107d (215db083-9e90-4472-9d3c-6bf807f7107d): created successfully Sep 28 18:28:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c2a6e44-9655-47da-a00e-f3ddf9d3c4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Flow 'volume_create_manager' (4743082e-0f1b-4275-b1af-4f4f45f6ad6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:37 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2eaa544-d7b6-4d69-8cf8-f79373e6954a]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fc252d01-3aef-4f12-a19a-59db8039321a tempest-SnapshotDependencyTests-1963002193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:37 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-d0728a12-57ce-4046-9604-94bd1df2297e tempest-CinderUnicodeTest-519549991 None] Created volume successfully. Sep 28 18:28:37 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70 Sep 28 18:28:37 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:37 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fc252d01-3aef-4f12-a19a-59db8039321a tempest-SnapshotDependencyTests-1963002193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70" returned: 0 in 0.515s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fc252d01-3aef-4f12-a19a-59db8039321a tempest-SnapshotDependencyTests-1963002193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70.d65d4132-8470-423e-8dd8-315835189073 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:37 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70.d65d4132-8470-423e-8dd8-315835189073 1G Sep 28 18:28:37 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8a8205b2-c428-4473-a4e8-c41331b14529 tempest-ProjectAdminTests-800243084 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1236991882324, 'free_capacity_gb': 1775.1236991882324, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86980) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 18:28:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2c0a12bf-93a9-41f1-a70e-b857ad5914c6 tempest-CinderUnicodeTest-519549991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:38 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fc252d01-3aef-4f12-a19a-59db8039321a tempest-SnapshotDependencyTests-1963002193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70.d65d4132-8470-423e-8dd8-315835189073 1G" returned: 0 in 0.685s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fc252d01-3aef-4f12-a19a-59db8039321a tempest-SnapshotDependencyTests-1963002193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea50356d-0f63-4993-a5df-52bd54685d70 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70.d65d4132-8470-423e-8dd8-315835189073 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:38 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea50356d-0f63-4993-a5df-52bd54685d70 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70.d65d4132-8470-423e-8dd8-315835189073 Sep 28 18:28:38 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:38 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fc252d01-3aef-4f12-a19a-59db8039321a tempest-SnapshotDependencyTests-1963002193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea50356d-0f63-4993-a5df-52bd54685d70 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70.d65d4132-8470-423e-8dd8-315835189073" returned: 0 in 0.441s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:38 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-fc252d01-3aef-4f12-a19a-59db8039321a tempest-SnapshotDependencyTests-1963002193 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70.d65d4132-8470-423e-8dd8-315835189073 is being set with open permissions: ugo+rw Sep 28 18:28:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fc252d01-3aef-4f12-a19a-59db8039321a tempest-SnapshotDependencyTests-1963002193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70.d65d4132-8470-423e-8dd8-315835189073 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:38 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70.d65d4132-8470-423e-8dd8-315835189073 Sep 28 18:28:38 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:38 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fc252d01-3aef-4f12-a19a-59db8039321a tempest-SnapshotDependencyTests-1963002193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70.d65d4132-8470-423e-8dd8-315835189073" returned: 0 in 0.326s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fc252d01-3aef-4f12-a19a-59db8039321a tempest-SnapshotDependencyTests-1963002193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:39 devstack sudo[108068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70.info Sep 28 18:28:39 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:39 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fc252d01-3aef-4f12-a19a-59db8039321a tempest-SnapshotDependencyTests-1963002193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70.info" returned: 0 in 0.352s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:39 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-fc252d01-3aef-4f12-a19a-59db8039321a tempest-SnapshotDependencyTests-1963002193 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70.info is being set with open permissions: ugo+rw Sep 28 18:28:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fc252d01-3aef-4f12-a19a-59db8039321a tempest-SnapshotDependencyTests-1963002193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:39 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70.info Sep 28 18:28:39 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:39 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fc252d01-3aef-4f12-a19a-59db8039321a tempest-SnapshotDependencyTests-1963002193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70.info" returned: 0 in 0.359s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-fc252d01-3aef-4f12-a19a-59db8039321a tempest-SnapshotDependencyTests-1963002193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.836s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2c0a12bf-93a9-41f1-a70e-b857ad5914c6 tempest-CinderUnicodeTest-519549991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.643s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-2c0a12bf-93a9-41f1-a70e-b857ad5914c6 tempest-CinderUnicodeTest-519549991 None] Creating offline snapshot 45cc1e0e-77e5-460b-a158-3038c50b8098 of volume 215db083-9e90-4472-9d3c-6bf807f7107d {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:28:39 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-fc252d01-3aef-4f12-a19a-59db8039321a tempest-SnapshotDependencyTests-1963002193 None] Create snapshot completed successfully Sep 28 18:28:39 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d5be22-9e14-40ac-b0b8-160a5ccfdd04]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2c0a12bf-93a9-41f1-a70e-b857ad5914c6 tempest-CinderUnicodeTest-519549991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:39 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d Sep 28 18:28:39 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:40 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2c0a12bf-93a9-41f1-a70e-b857ad5914c6 tempest-CinderUnicodeTest-519549991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d" returned: 0 in 0.463s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2c0a12bf-93a9-41f1-a70e-b857ad5914c6 tempest-CinderUnicodeTest-519549991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d.45cc1e0e-77e5-460b-a158-3038c50b8098 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:40 devstack sudo[108080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d.45cc1e0e-77e5-460b-a158-3038c50b8098 1G Sep 28 18:28:40 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:40 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2c0a12bf-93a9-41f1-a70e-b857ad5914c6 tempest-CinderUnicodeTest-519549991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d.45cc1e0e-77e5-460b-a158-3038c50b8098 1G" returned: 0 in 0.599s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2c0a12bf-93a9-41f1-a70e-b857ad5914c6 tempest-CinderUnicodeTest-519549991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-215db083-9e90-4472-9d3c-6bf807f7107d -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d.45cc1e0e-77e5-460b-a158-3038c50b8098 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:40 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-215db083-9e90-4472-9d3c-6bf807f7107d -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d.45cc1e0e-77e5-460b-a158-3038c50b8098 Sep 28 18:28:40 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:41 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2c0a12bf-93a9-41f1-a70e-b857ad5914c6 tempest-CinderUnicodeTest-519549991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-215db083-9e90-4472-9d3c-6bf807f7107d -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d.45cc1e0e-77e5-460b-a158-3038c50b8098" returned: 0 in 0.459s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:41 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-2c0a12bf-93a9-41f1-a70e-b857ad5914c6 tempest-CinderUnicodeTest-519549991 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d.45cc1e0e-77e5-460b-a158-3038c50b8098 is being set with open permissions: ugo+rw Sep 28 18:28:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2c0a12bf-93a9-41f1-a70e-b857ad5914c6 tempest-CinderUnicodeTest-519549991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d.45cc1e0e-77e5-460b-a158-3038c50b8098 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:41 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d.45cc1e0e-77e5-460b-a158-3038c50b8098 Sep 28 18:28:41 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:41 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:28:41 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2c0a12bf-93a9-41f1-a70e-b857ad5914c6 tempest-CinderUnicodeTest-519549991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d.45cc1e0e-77e5-460b-a158-3038c50b8098" returned: 0 in 0.331s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Flow 'volume_create_manager' (d5793eb7-4006-4a55-b3a5-ca9a9972d6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e029c40-c5c8-4fc9-baa0-b8e4706f7824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e029c40-c5c8-4fc9-baa0-b8e4706f7824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7325e10a-637a-4a46-af9a-026e82f8a3c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ce4b7227db4814b4110a415a2a26db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d65d4132-8470-423e-8dd8-315835189073,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:42Z,use_quota=True,user_id='b8822b75f395415890ecdbd08c5250af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b3b1d7-b588-45bf-9915-f83f1e55303f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b3b1d7-b588-45bf-9915-f83f1e55303f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed2f638-32ec-438f-9f92-668453aadaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed2f638-32ec-438f-9f92-668453aadaf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7325e10a-637a-4a46-af9a-026e82f8a3c6', 'volume_name': 'volume-7325e10a-637a-4a46-af9a-026e82f8a3c6', 'volume_size': 1, 'snapshot_id': 'd65d4132-8470-423e-8dd8-315835189073'}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (961e7aa7-5e08-4927-b3cf-47e3b57d00a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (961e7aa7-5e08-4927-b3cf-47e3b57d00a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25962151-d55f-4928-b9b5-ec7d77d54580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:41 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Volume 7325e10a-637a-4a46-af9a-026e82f8a3c6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7325e10a-637a-4a46-af9a-026e82f8a3c6', 'volume_size': 1, 'snapshot_id': 'd65d4132-8470-423e-8dd8-315835189073'} Sep 28 18:28:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2c0a12bf-93a9-41f1-a70e-b857ad5914c6 tempest-CinderUnicodeTest-519549991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:41 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d.info Sep 28 18:28:41 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:42 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2c0a12bf-93a9-41f1-a70e-b857ad5914c6 tempest-CinderUnicodeTest-519549991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d.info" returned: 0 in 0.308s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:42 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-2c0a12bf-93a9-41f1-a70e-b857ad5914c6 tempest-CinderUnicodeTest-519549991 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d.info is being set with open permissions: ugo+rw Sep 28 18:28:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2c0a12bf-93a9-41f1-a70e-b857ad5914c6 tempest-CinderUnicodeTest-519549991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:42 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d.info Sep 28 18:28:42 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:42 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2c0a12bf-93a9-41f1-a70e-b857ad5914c6 tempest-CinderUnicodeTest-519549991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d.info" returned: 0 in 0.357s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2c0a12bf-93a9-41f1-a70e-b857ad5914c6 tempest-CinderUnicodeTest-519549991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.746s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.698s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Acquiring lock "cinder-quobyte-d65d4132-8470-423e-8dd8-315835189073-7325e10a-637a-4a46-af9a-026e82f8a3c6" by "_create_volume_from_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Lock "cinder-quobyte-d65d4132-8470-423e-8dd8-315835189073-7325e10a-637a-4a46-af9a-026e82f8a3c6" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Creating volume 7325e10a-637a-4a46-af9a-026e82f8a3c6 from snapshot d65d4132-8470-423e-8dd8-315835189073 {{(pid=86980) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 18:28:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:28:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Acquiring lock "cinder-quobyte-7325e10a-637a-4a46-af9a-026e82f8a3c6" by "_copy_volume_from_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:42 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-2c0a12bf-93a9-41f1-a70e-b857ad5914c6 tempest-CinderUnicodeTest-519549991 None] Create snapshot completed successfully Sep 28 18:28:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Lock "cinder-quobyte-7325e10a-637a-4a46-af9a-026e82f8a3c6" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] snapshot: d65d4132-8470-423e-8dd8-315835189073, volume: 7325e10a-637a-4a46-af9a-026e82f8a3c6, {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 18:28:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:42 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcfeb46-1c16-41b1-adbf-bb78e838835f]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70.d65d4132-8470-423e-8dd8-315835189073 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:42 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70.d65d4132-8470-423e-8dd8-315835189073 Sep 28 18:28:42 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:43 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70.d65d4132-8470-423e-8dd8-315835189073" returned: 0 in 0.478s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea50356d-0f63-4993-a5df-52bd54685d70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:28:43 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58348de-06cd-4722-91b6-89fbe264d683]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:43 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70 Sep 28 18:28:43 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1f4d2519-ccd9-43c0-97d7-dff936dad56b tempest-CinderUnicodeTest-519549991 None] Acquiring lock "cinder-45cc1e0e-77e5-460b-a158-3038c50b8098-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1f4d2519-ccd9-43c0-97d7-dff936dad56b tempest-CinderUnicodeTest-519549991 None] Lock "cinder-45cc1e0e-77e5-460b-a158-3038c50b8098-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1f4d2519-ccd9-43c0-97d7-dff936dad56b tempest-CinderUnicodeTest-519549991 None] Acquiring lock "cinder-quobyte-215db083-9e90-4472-9d3c-6bf807f7107d" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1f4d2519-ccd9-43c0-97d7-dff936dad56b tempest-CinderUnicodeTest-519549991 None] Lock "cinder-quobyte-215db083-9e90-4472-9d3c-6bf807f7107d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1f4d2519-ccd9-43c0-97d7-dff936dad56b tempest-CinderUnicodeTest-519549991 None] Acquiring lock "cinder-quobyte-45cc1e0e-77e5-460b-a158-3038c50b8098" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1f4d2519-ccd9-43c0-97d7-dff936dad56b tempest-CinderUnicodeTest-519549991 None] Lock "cinder-quobyte-45cc1e0e-77e5-460b-a158-3038c50b8098" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-1f4d2519-ccd9-43c0-97d7-dff936dad56b tempest-CinderUnicodeTest-519549991 None] Deleting offline snapshot 45cc1e0e-77e5-460b-a158-3038c50b8098 of volume 215db083-9e90-4472-9d3c-6bf807f7107d {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:28:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-1f4d2519-ccd9-43c0-97d7-dff936dad56b tempest-CinderUnicodeTest-519549991 None] snapshot_file for this snap is: volume-215db083-9e90-4472-9d3c-6bf807f7107d.45cc1e0e-77e5-460b-a158-3038c50b8098 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:28:43 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9c5158-fd6b-4db9-a9bd-f5e4ae4be241]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1f4d2519-ccd9-43c0-97d7-dff936dad56b tempest-CinderUnicodeTest-519549991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d.45cc1e0e-77e5-460b-a158-3038c50b8098 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:43 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d.45cc1e0e-77e5-460b-a158-3038c50b8098 Sep 28 18:28:43 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:43 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70" returned: 0 in 0.571s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70 {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 18:28:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Creating direct copy from snapshot {{(pid=86980) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 18:28:43 devstack cinder-volume[86980]: DEBUG cinder.utils [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Path /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7325e10a-637a-4a46-af9a-026e82f8a3c6 not found in is_blk_device check {{(pid=86980) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 18:28:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7325e10a-637a-4a46-af9a-026e82f8a3c6 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:43 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7325e10a-637a-4a46-af9a-026e82f8a3c6 Sep 28 18:28:43 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:44 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1f4d2519-ccd9-43c0-97d7-dff936dad56b tempest-CinderUnicodeTest-519549991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d.45cc1e0e-77e5-460b-a158-3038c50b8098" returned: 0 in 0.502s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:44 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-1f4d2519-ccd9-43c0-97d7-dff936dad56b tempest-CinderUnicodeTest-519549991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-215db083-9e90-4472-9d3c-6bf807f7107d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:28:44 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee2d4f6-a477-4216-ba8a-530749991fd7]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1f4d2519-ccd9-43c0-97d7-dff936dad56b tempest-CinderUnicodeTest-519549991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:44 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d Sep 28 18:28:44 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:44 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1f4d2519-ccd9-43c0-97d7-dff936dad56b tempest-CinderUnicodeTest-519549991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d" returned: 0 in 0.690s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1f4d2519-ccd9-43c0-97d7-dff936dad56b tempest-CinderUnicodeTest-519549991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d.45cc1e0e-77e5-460b-a158-3038c50b8098 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:44 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d.45cc1e0e-77e5-460b-a158-3038c50b8098 Sep 28 18:28:44 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:46 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1f4d2519-ccd9-43c0-97d7-dff936dad56b tempest-CinderUnicodeTest-519549991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d.45cc1e0e-77e5-460b-a158-3038c50b8098" returned: 0 in 1.414s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1f4d2519-ccd9-43c0-97d7-dff936dad56b tempest-CinderUnicodeTest-519549991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d.45cc1e0e-77e5-460b-a158-3038c50b8098 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:46 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d.45cc1e0e-77e5-460b-a158-3038c50b8098 Sep 28 18:28:46 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:46 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1f4d2519-ccd9-43c0-97d7-dff936dad56b tempest-CinderUnicodeTest-519549991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d.45cc1e0e-77e5-460b-a158-3038c50b8098" returned: 0 in 0.544s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:46 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1f4d2519-ccd9-43c0-97d7-dff936dad56b tempest-CinderUnicodeTest-519549991 None] Lock "cinder-quobyte-45cc1e0e-77e5-460b-a158-3038c50b8098" released by "_delete_snapshot" :: held 3.375s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:46 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1f4d2519-ccd9-43c0-97d7-dff936dad56b tempest-CinderUnicodeTest-519549991 None] Lock "cinder-quobyte-215db083-9e90-4472-9d3c-6bf807f7107d" released by "delete_snapshot" :: held 3.408s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:47 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-1f4d2519-ccd9-43c0-97d7-dff936dad56b tempest-CinderUnicodeTest-519549991 None] Created reservations ['0f8ac514-35e2-43f7-acff-68e67414bb0a', '2a4ec269-4927-4472-ac4b-cc5635fc18df', '76d05298-2096-42f8-b712-50b2bba38241', '0d6257d9-e111-42aa-963e-8542b459df08'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:47 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-1f4d2519-ccd9-43c0-97d7-dff936dad56b tempest-CinderUnicodeTest-519549991 None] Delete snapshot completed successfully. Sep 28 18:28:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1f4d2519-ccd9-43c0-97d7-dff936dad56b tempest-CinderUnicodeTest-519549991 None] Lock "cinder-45cc1e0e-77e5-460b-a158-3038c50b8098-delete_snapshot" released by "delete_snapshot" :: held 3.790s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:48 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-be81533a-8e47-4308-8f13-0959719bb718 tempest-CinderUnicodeTest-519549991 None] Acquiring lock "cinder-215db083-9e90-4472-9d3c-6bf807f7107d-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:48 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-be81533a-8e47-4308-8f13-0959719bb718 tempest-CinderUnicodeTest-519549991 None] Lock "cinder-215db083-9e90-4472-9d3c-6bf807f7107d-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:48 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-be81533a-8e47-4308-8f13-0959719bb718 tempest-CinderUnicodeTest-519549991 None] Acquiring lock "cinder-quobyte-215db083-9e90-4472-9d3c-6bf807f7107d" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:48 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-be81533a-8e47-4308-8f13-0959719bb718 tempest-CinderUnicodeTest-519549991 None] Lock "cinder-quobyte-215db083-9e90-4472-9d3c-6bf807f7107d" acquired by "delete_volume" :: waited 0.049s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:48 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cc07ab-f831-4df5-bc43-c13417f974b1]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-be81533a-8e47-4308-8f13-0959719bb718 tempest-CinderUnicodeTest-519549991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:48 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d Sep 28 18:28:48 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:49 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-be81533a-8e47-4308-8f13-0959719bb718 tempest-CinderUnicodeTest-519549991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d" returned: 0 in 0.879s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-be81533a-8e47-4308-8f13-0959719bb718 tempest-CinderUnicodeTest-519549991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:49 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d Sep 28 18:28:49 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:49 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-be81533a-8e47-4308-8f13-0959719bb718 tempest-CinderUnicodeTest-519549991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-215db083-9e90-4472-9d3c-6bf807f7107d" returned: 0 in 0.591s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:49 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-be81533a-8e47-4308-8f13-0959719bb718 tempest-CinderUnicodeTest-519549991 None] Lock "cinder-quobyte-215db083-9e90-4472-9d3c-6bf807f7107d" released by "delete_volume" :: held 1.688s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:50 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-be81533a-8e47-4308-8f13-0959719bb718 tempest-CinderUnicodeTest-519549991 None] Created reservations ['241c1308-ec93-4925-a018-fdf56f4728b3', '48e1c8f3-f5c9-4b1c-9901-45b0975f5118', 'def33f0b-adba-4efb-967f-3a9219b5ff39', '73d49b40-1e3f-4a76-8f4a-89f7e4a47005'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-be81533a-8e47-4308-8f13-0959719bb718 tempest-CinderUnicodeTest-519549991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-be81533a-8e47-4308-8f13-0959719bb718 tempest-CinderUnicodeTest-519549991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-be81533a-8e47-4308-8f13-0959719bb718 tempest-CinderUnicodeTest-519549991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-be81533a-8e47-4308-8f13-0959719bb718 tempest-CinderUnicodeTest-519549991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-be81533a-8e47-4308-8f13-0959719bb718 tempest-CinderUnicodeTest-519549991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-be81533a-8e47-4308-8f13-0959719bb718 tempest-CinderUnicodeTest-519549991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:50 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:28:50 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:50 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6b2ecdeb-911e-4aae-a938-33116bafe3df tempest-CinderUnicodeTest-519549991 None] Acquiring lock "cinder-10d2ad0f-17a3-4613-8299-14de09d97740-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:50 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6b2ecdeb-911e-4aae-a938-33116bafe3df tempest-CinderUnicodeTest-519549991 None] Lock "cinder-10d2ad0f-17a3-4613-8299-14de09d97740-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:50 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6b2ecdeb-911e-4aae-a938-33116bafe3df tempest-CinderUnicodeTest-519549991 None] Acquiring lock "cinder-quobyte-10d2ad0f-17a3-4613-8299-14de09d97740" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:50 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6b2ecdeb-911e-4aae-a938-33116bafe3df tempest-CinderUnicodeTest-519549991 None] Lock "cinder-quobyte-10d2ad0f-17a3-4613-8299-14de09d97740" acquired by "delete_volume" :: waited 0.069s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:51 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-be81533a-8e47-4308-8f13-0959719bb718 tempest-CinderUnicodeTest-519549991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.668s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:51 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-be81533a-8e47-4308-8f13-0959719bb718 tempest-CinderUnicodeTest-519549991 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:28:51 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-be81533a-8e47-4308-8f13-0959719bb718 tempest-CinderUnicodeTest-519549991 None] Deleted volume successfully. Sep 28 18:28:51 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[45726843-9804-4fdb-a1ed-a54c82d75ec2]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6b2ecdeb-911e-4aae-a938-33116bafe3df tempest-CinderUnicodeTest-519549991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-10d2ad0f-17a3-4613-8299-14de09d97740 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:51 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-be81533a-8e47-4308-8f13-0959719bb718 tempest-CinderUnicodeTest-519549991 None] Lock "cinder-215db083-9e90-4472-9d3c-6bf807f7107d-delete_volume" released by "delete_volume" :: held 3.009s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:51 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-10d2ad0f-17a3-4613-8299-14de09d97740 Sep 28 18:28:51 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:52 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6b2ecdeb-911e-4aae-a938-33116bafe3df tempest-CinderUnicodeTest-519549991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-10d2ad0f-17a3-4613-8299-14de09d97740" returned: 0 in 1.115s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6b2ecdeb-911e-4aae-a938-33116bafe3df tempest-CinderUnicodeTest-519549991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-10d2ad0f-17a3-4613-8299-14de09d97740 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:52 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-10d2ad0f-17a3-4613-8299-14de09d97740 Sep 28 18:28:52 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:52 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6b2ecdeb-911e-4aae-a938-33116bafe3df tempest-CinderUnicodeTest-519549991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-10d2ad0f-17a3-4613-8299-14de09d97740" returned: 0 in 0.501s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:52 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6b2ecdeb-911e-4aae-a938-33116bafe3df tempest-CinderUnicodeTest-519549991 None] Lock "cinder-quobyte-10d2ad0f-17a3-4613-8299-14de09d97740" released by "delete_volume" :: held 1.772s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:52 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-6b2ecdeb-911e-4aae-a938-33116bafe3df tempest-CinderUnicodeTest-519549991 None] Created reservations ['17369cf3-1cb9-445e-a54e-cf7858b84ffc', '26fd79c9-a815-4413-aeff-d6da2d11ccdf', '8a2cb152-2251-4fa4-8346-ec6f6f58331a', '1cd2b706-3942-4ff4-9ed4-b103fdf1d510'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6b2ecdeb-911e-4aae-a938-33116bafe3df tempest-CinderUnicodeTest-519549991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6b2ecdeb-911e-4aae-a938-33116bafe3df tempest-CinderUnicodeTest-519549991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6b2ecdeb-911e-4aae-a938-33116bafe3df tempest-CinderUnicodeTest-519549991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6b2ecdeb-911e-4aae-a938-33116bafe3df tempest-CinderUnicodeTest-519549991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6b2ecdeb-911e-4aae-a938-33116bafe3df tempest-CinderUnicodeTest-519549991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6b2ecdeb-911e-4aae-a938-33116bafe3df tempest-CinderUnicodeTest-519549991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:53 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:28:53 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:53 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6b2ecdeb-911e-4aae-a938-33116bafe3df tempest-CinderUnicodeTest-519549991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.528s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:53 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6b2ecdeb-911e-4aae-a938-33116bafe3df tempest-CinderUnicodeTest-519549991 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:28:53 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-6b2ecdeb-911e-4aae-a938-33116bafe3df tempest-CinderUnicodeTest-519549991 None] Deleted volume successfully. Sep 28 18:28:53 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6b2ecdeb-911e-4aae-a938-33116bafe3df tempest-CinderUnicodeTest-519549991 None] Lock "cinder-10d2ad0f-17a3-4613-8299-14de09d97740-delete_volume" released by "delete_volume" :: held 2.913s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:53 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7325e10a-637a-4a46-af9a-026e82f8a3c6" returned: 0 in 10.197s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:53 devstack cinder-volume[86980]: DEBUG cinder.image.image_utils [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Image conversion details: src /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70, size 1024.00 MB, duration 10.20 sec, destination /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7325e10a-637a-4a46-af9a-026e82f8a3c6 {{(pid=86980) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 18:28:53 devstack cinder-volume[86980]: INFO cinder.image.image_utils [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Converted 1024.00 MB image at 100.40 MB/s Sep 28 18:28:54 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7325e10a-637a-4a46-af9a-026e82f8a3c6 is being set with open permissions: ugo+rw Sep 28 18:28:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7325e10a-637a-4a46-af9a-026e82f8a3c6 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:54 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7325e10a-637a-4a46-af9a-026e82f8a3c6 Sep 28 18:28:54 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:54 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7325e10a-637a-4a46-af9a-026e82f8a3c6" returned: 0 in 0.333s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:54 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Lock "cinder-quobyte-7325e10a-637a-4a46-af9a-026e82f8a3c6" released by "_copy_volume_from_snapshot" :: held 11.736s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:54 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Lock "cinder-quobyte-d65d4132-8470-423e-8dd8-315835189073-7325e10a-637a-4a46-af9a-026e82f8a3c6" released by "_create_volume_from_snapshot" :: held 11.842s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.887s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25962151-d55f-4928-b9b5-ec7d77d54580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7325e10a-637a-4a46-af9a-026e82f8a3c6', 'volume_size': 1, 'snapshot_id': 'd65d4132-8470-423e-8dd8-315835189073'}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fea0abd-9c39-4a7c-bcfd-bd4eca0e4171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:54 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Volume volume-7325e10a-637a-4a46-af9a-026e82f8a3c6 (7325e10a-637a-4a46-af9a-026e82f8a3c6): created successfully Sep 28 18:28:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fea0abd-9c39-4a7c-bcfd-bd4eca0e4171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:54 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Flow 'volume_create_manager' (d5793eb7-4006-4a55-b3a5-ca9a9972d6c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:54 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-d39a9ded-6000-4cfa-a543-c6f989ac8b1c tempest-SnapshotDependencyTests-1963002193 None] Created volume successfully. Sep 28 18:28:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-92334d26-5e50-4e82-aab5-f680fe17623e tempest-SnapshotDependencyTests-1963002193 None] Acquiring lock "cinder-d65d4132-8470-423e-8dd8-315835189073-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-92334d26-5e50-4e82-aab5-f680fe17623e tempest-SnapshotDependencyTests-1963002193 None] Lock "cinder-d65d4132-8470-423e-8dd8-315835189073-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-92334d26-5e50-4e82-aab5-f680fe17623e tempest-SnapshotDependencyTests-1963002193 None] Acquiring lock "cinder-quobyte-ea50356d-0f63-4993-a5df-52bd54685d70" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-92334d26-5e50-4e82-aab5-f680fe17623e tempest-SnapshotDependencyTests-1963002193 None] Lock "cinder-quobyte-ea50356d-0f63-4993-a5df-52bd54685d70" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-92334d26-5e50-4e82-aab5-f680fe17623e tempest-SnapshotDependencyTests-1963002193 None] Acquiring lock "cinder-quobyte-d65d4132-8470-423e-8dd8-315835189073" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:55 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-92334d26-5e50-4e82-aab5-f680fe17623e tempest-SnapshotDependencyTests-1963002193 None] Lock "cinder-quobyte-d65d4132-8470-423e-8dd8-315835189073" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:55 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-92334d26-5e50-4e82-aab5-f680fe17623e tempest-SnapshotDependencyTests-1963002193 None] Deleting offline snapshot d65d4132-8470-423e-8dd8-315835189073 of volume ea50356d-0f63-4993-a5df-52bd54685d70 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:28:55 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-92334d26-5e50-4e82-aab5-f680fe17623e tempest-SnapshotDependencyTests-1963002193 None] snapshot_file for this snap is: volume-ea50356d-0f63-4993-a5df-52bd54685d70.d65d4132-8470-423e-8dd8-315835189073 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:28:55 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2015e425-4acf-4c69-966d-d442522fb932]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-92334d26-5e50-4e82-aab5-f680fe17623e tempest-SnapshotDependencyTests-1963002193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70.d65d4132-8470-423e-8dd8-315835189073 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:55 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70.d65d4132-8470-423e-8dd8-315835189073 Sep 28 18:28:55 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:55 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:28:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Flow 'volume_create_manager' (b647b71d-a0a4-4427-8410-a54a46c9b140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:55 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94bbba98-2b6b-41ba-b9ab-799dc4727d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94bbba98-2b6b-41ba-b9ab-799dc4727d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-112693946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebbd1a59-4b70-4dc2-992d-9e6484e04a79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9e99502d25421799dbe9850a9f19de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:56Z,use_quota=True,user_id='e2b01c6a248345f2a380ffc12b39bfb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (779971be-c362-44a6-a17d-339bae08f317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (779971be-c362-44a6-a17d-339bae08f317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8628f9ee-a0f7-4da3-b792-8ae7abb6cb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8628f9ee-a0f7-4da3-b792-8ae7abb6cb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebbd1a59-4b70-4dc2-992d-9e6484e04a79', 'volume_name': 'volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db9a129-0457-4b51-8e4d-071bae4f2ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db9a129-0457-4b51-8e4d-071bae4f2ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:56 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c495ec5-5bd5-4da6-ba0f-ef7b68eafd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:56 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Volume ebbd1a59-4b70-4dc2-992d-9e6484e04a79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79', 'volume_size': 1} Sep 28 18:28:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-112693946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebbd1a59-4b70-4dc2-992d-9e6484e04a79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9e99502d25421799dbe9850a9f19de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:56Z,use_quota=True,user_id='e2b01c6a248345f2a380ffc12b39bfb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:28:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Creating volume ebbd1a59-4b70-4dc2-992d-9e6484e04a79 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:28:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:28:56 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:28:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:56 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79 1073741824 Sep 28 18:28:56 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:56 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-92334d26-5e50-4e82-aab5-f680fe17623e tempest-SnapshotDependencyTests-1963002193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70.d65d4132-8470-423e-8dd8-315835189073" returned: 0 in 0.577s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-92334d26-5e50-4e82-aab5-f680fe17623e tempest-SnapshotDependencyTests-1963002193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea50356d-0f63-4993-a5df-52bd54685d70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:28:56 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf499aa9-1ab4-4a95-835d-0f89c5e74be0]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-92334d26-5e50-4e82-aab5-f680fe17623e tempest-SnapshotDependencyTests-1963002193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:56 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70 Sep 28 18:28:56 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:56 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79 1073741824" returned: 0 in 0.631s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:56 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79 Sep 28 18:28:56 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:56 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-92334d26-5e50-4e82-aab5-f680fe17623e tempest-SnapshotDependencyTests-1963002193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70" returned: 0 in 0.771s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-92334d26-5e50-4e82-aab5-f680fe17623e tempest-SnapshotDependencyTests-1963002193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70.d65d4132-8470-423e-8dd8-315835189073 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:57 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70.d65d4132-8470-423e-8dd8-315835189073 Sep 28 18:28:57 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Flow 'volume_create_manager' (71365798-586a-403e-84d8-f9b2cd841ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eae5e168-0cb9-42c6-bbbe-77b2489d2d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:57 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79" returned: 0 in 0.365s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eae5e168-0cb9-42c6-bbbe-77b2489d2d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1575032645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=599e00b2-7774-438f-a1ae-0a031c01906d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1948c9fc1164a59b35b4b7768aff4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:57Z,use_quota=True,user_id='cfbd883b39484aefa90aca900ddc3986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fcde1ed-6742-42e0-a198-5ef875d53b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fcde1ed-6742-42e0-a198-5ef875d53b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d4b6e66-51e7-431c-a5a0-504a95a4c16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d4b6e66-51e7-431c-a5a0-504a95a4c16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '599e00b2-7774-438f-a1ae-0a031c01906d', 'volume_name': 'volume-599e00b2-7774-438f-a1ae-0a031c01906d', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0876046-e5ee-4926-b222-a17841d233cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0876046-e5ee-4926-b222-a17841d233cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de558696-aff1-4a89-836c-b3747f34237f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:57 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Volume 599e00b2-7774-438f-a1ae-0a031c01906d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-599e00b2-7774-438f-a1ae-0a031c01906d', 'volume_size': 1} Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1575032645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=599e00b2-7774-438f-a1ae-0a031c01906d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1948c9fc1164a59b35b4b7768aff4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:28:57Z,use_quota=True,user_id='cfbd883b39484aefa90aca900ddc3986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Creating volume 599e00b2-7774-438f-a1ae-0a031c01906d {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:28:57 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-599e00b2-7774-438f-a1ae-0a031c01906d 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c495ec5-5bd5-4da6-ba0f-ef7b68eafd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31affd11-ca86-4255-a064-9f4e5d5288fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:57 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-599e00b2-7774-438f-a1ae-0a031c01906d 1073741824 Sep 28 18:28:57 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:57 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Volume volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79 (ebbd1a59-4b70-4dc2-992d-9e6484e04a79): created successfully Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31affd11-ca86-4255-a064-9f4e5d5288fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Flow 'volume_create_manager' (b647b71d-a0a4-4427-8410-a54a46c9b140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:57 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-6d23d53f-d939-4daf-8bc7-0577672c3394 tempest-ProjectMemberTests-1075311172 None] Created volume successfully. Sep 28 18:28:57 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-92334d26-5e50-4e82-aab5-f680fe17623e tempest-SnapshotDependencyTests-1963002193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70.d65d4132-8470-423e-8dd8-315835189073" returned: 0 in 0.451s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-92334d26-5e50-4e82-aab5-f680fe17623e tempest-SnapshotDependencyTests-1963002193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70.d65d4132-8470-423e-8dd8-315835189073 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:57 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70.d65d4132-8470-423e-8dd8-315835189073 Sep 28 18:28:57 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:57 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-92334d26-5e50-4e82-aab5-f680fe17623e tempest-SnapshotDependencyTests-1963002193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70.d65d4132-8470-423e-8dd8-315835189073" returned: 0 in 0.305s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-92334d26-5e50-4e82-aab5-f680fe17623e tempest-SnapshotDependencyTests-1963002193 None] Lock "cinder-quobyte-d65d4132-8470-423e-8dd8-315835189073" released by "_delete_snapshot" :: held 2.278s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:57 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-92334d26-5e50-4e82-aab5-f680fe17623e tempest-SnapshotDependencyTests-1963002193 None] Lock "cinder-quobyte-ea50356d-0f63-4993-a5df-52bd54685d70" released by "delete_snapshot" :: held 2.318s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-599e00b2-7774-438f-a1ae-0a031c01906d 1073741824" returned: 0 in 0.609s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-599e00b2-7774-438f-a1ae-0a031c01906d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:57 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-599e00b2-7774-438f-a1ae-0a031c01906d Sep 28 18:28:57 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:57 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-92334d26-5e50-4e82-aab5-f680fe17623e tempest-SnapshotDependencyTests-1963002193 None] Created reservations ['be93cf8b-7e21-449a-bbc5-50d8022fdf65', '77b1b49e-bae3-430c-a876-12f3a5026af6', '550efca9-7ca3-4768-afb9-b6e7bc4be15d', 'b1a9007a-6867-4f97-a7b1-c1d8f774b7ff'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:57 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-92334d26-5e50-4e82-aab5-f680fe17623e tempest-SnapshotDependencyTests-1963002193 None] Delete snapshot completed successfully. Sep 28 18:28:58 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-92334d26-5e50-4e82-aab5-f680fe17623e tempest-SnapshotDependencyTests-1963002193 None] Lock "cinder-d65d4132-8470-423e-8dd8-315835189073-delete_snapshot" released by "delete_snapshot" :: held 2.543s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:58 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-599e00b2-7774-438f-a1ae-0a031c01906d" returned: 0 in 0.274s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:28:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de558696-aff1-4a89-836c-b3747f34237f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-599e00b2-7774-438f-a1ae-0a031c01906d', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37fe5ae2-2a3b-4aaa-a49c-c76b111792de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:28:58 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Volume volume-599e00b2-7774-438f-a1ae-0a031c01906d (599e00b2-7774-438f-a1ae-0a031c01906d): created successfully Sep 28 18:28:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37fe5ae2-2a3b-4aaa-a49c-c76b111792de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:28:58 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Flow 'volume_create_manager' (71365798-586a-403e-84d8-f9b2cd841ba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:28:58 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-11a20d25-778d-423e-a955-3c943be44183 tempest-ProjectReaderTests-1186385509 None] Created volume successfully. Sep 28 18:28:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-84b37169-d2e9-4097-89d7-9b2793c5503a tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-84b37169-d2e9-4097-89d7-9b2793c5503a tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:58 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-84b37169-d2e9-4097-89d7-9b2793c5503a tempest-ProjectMemberTests-1075311172 None] Creating offline snapshot 41a8c94e-3f1f-42aa-87bb-9223de3a019e of volume ebbd1a59-4b70-4dc2-992d-9e6484e04a79 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:28:58 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e1e03f-9235-473b-a1c4-86c0cab765d0]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-84b37169-d2e9-4097-89d7-9b2793c5503a tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:58 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79 Sep 28 18:28:58 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:58 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-70ba9a08-f902-4072-b1a6-631ea5056bc4 tempest-SnapshotDependencyTests-1963002193 None] Acquiring lock "cinder-ea50356d-0f63-4993-a5df-52bd54685d70-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:58 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-70ba9a08-f902-4072-b1a6-631ea5056bc4 tempest-SnapshotDependencyTests-1963002193 None] Lock "cinder-ea50356d-0f63-4993-a5df-52bd54685d70-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:58 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-70ba9a08-f902-4072-b1a6-631ea5056bc4 tempest-SnapshotDependencyTests-1963002193 None] Acquiring lock "cinder-quobyte-ea50356d-0f63-4993-a5df-52bd54685d70" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:58 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-70ba9a08-f902-4072-b1a6-631ea5056bc4 tempest-SnapshotDependencyTests-1963002193 None] Lock "cinder-quobyte-ea50356d-0f63-4993-a5df-52bd54685d70" acquired by "delete_volume" :: waited 0.025s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:58 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7adb96b-0cdc-46a5-9b11-8a53ccee1ddf]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-70ba9a08-f902-4072-b1a6-631ea5056bc4 tempest-SnapshotDependencyTests-1963002193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:58 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-84b37169-d2e9-4097-89d7-9b2793c5503a tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79" returned: 0 in 0.458s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-84b37169-d2e9-4097-89d7-9b2793c5503a tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79.41a8c94e-3f1f-42aa-87bb-9223de3a019e 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:58 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79.41a8c94e-3f1f-42aa-87bb-9223de3a019e 1G Sep 28 18:28:58 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:59 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70 Sep 28 18:28:59 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:59 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-70ba9a08-f902-4072-b1a6-631ea5056bc4 tempest-SnapshotDependencyTests-1963002193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70" returned: 0 in 0.431s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-70ba9a08-f902-4072-b1a6-631ea5056bc4 tempest-SnapshotDependencyTests-1963002193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:59 devstack sudo[108229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70 Sep 28 18:28:59 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:59 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-84b37169-d2e9-4097-89d7-9b2793c5503a tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79.41a8c94e-3f1f-42aa-87bb-9223de3a019e 1G" returned: 0 in 0.521s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-84b37169-d2e9-4097-89d7-9b2793c5503a tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79.41a8c94e-3f1f-42aa-87bb-9223de3a019e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:59 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79.41a8c94e-3f1f-42aa-87bb-9223de3a019e Sep 28 18:28:59 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-2842ac91-f538-4d28-a6a6-e2943de59438 tempest-ProjectReaderTests-1186385509 None] Acquiring lock "cinder-599e00b2-7774-438f-a1ae-0a031c01906d-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-2842ac91-f538-4d28-a6a6-e2943de59438 tempest-ProjectReaderTests-1186385509 None] Lock "cinder-599e00b2-7774-438f-a1ae-0a031c01906d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-2842ac91-f538-4d28-a6a6-e2943de59438 tempest-ProjectReaderTests-1186385509 None] Acquiring lock "cinder-quobyte-599e00b2-7774-438f-a1ae-0a031c01906d" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:28:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-2842ac91-f538-4d28-a6a6-e2943de59438 tempest-ProjectReaderTests-1186385509 None] Lock "cinder-quobyte-599e00b2-7774-438f-a1ae-0a031c01906d" acquired by "delete_volume" :: waited 0.021s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:28:59 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[61140cc3-07e9-4de4-9f3d-5d30f2213823]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:28:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2842ac91-f538-4d28-a6a6-e2943de59438 tempest-ProjectReaderTests-1186385509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-599e00b2-7774-438f-a1ae-0a031c01906d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:59 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-70ba9a08-f902-4072-b1a6-631ea5056bc4 tempest-SnapshotDependencyTests-1963002193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ea50356d-0f63-4993-a5df-52bd54685d70" returned: 0 in 0.377s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-70ba9a08-f902-4072-b1a6-631ea5056bc4 tempest-SnapshotDependencyTests-1963002193 None] Lock "cinder-quobyte-ea50356d-0f63-4993-a5df-52bd54685d70" released by "delete_volume" :: held 0.892s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:28:59 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-599e00b2-7774-438f-a1ae-0a031c01906d Sep 28 18:28:59 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:59 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-70ba9a08-f902-4072-b1a6-631ea5056bc4 tempest-SnapshotDependencyTests-1963002193 None] Created reservations ['08240706-c8cf-4b6d-8a68-b407642811e7', 'c2f7f665-c91b-47b7-ba27-1c4f7031549b', '57dac54f-9860-49e4-a3e9-4577a1a0123c', '22106311-cdb8-4f3c-bc09-ca3385a361d6'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:28:59 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Sep 28 18:28:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-84b37169-d2e9-4097-89d7-9b2793c5503a tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79.41a8c94e-3f1f-42aa-87bb-9223de3a019e" returned: 0 in 0.439s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:28:59 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-84b37169-d2e9-4097-89d7-9b2793c5503a tempest-ProjectMemberTests-1075311172 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79.41a8c94e-3f1f-42aa-87bb-9223de3a019e is being set with open permissions: ugo+rw Sep 28 18:28:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-84b37169-d2e9-4097-89d7-9b2793c5503a tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79.41a8c94e-3f1f-42aa-87bb-9223de3a019e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:28:59 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79.41a8c94e-3f1f-42aa-87bb-9223de3a019e Sep 28 18:28:59 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:28:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-70ba9a08-f902-4072-b1a6-631ea5056bc4 tempest-SnapshotDependencyTests-1963002193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:28:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-70ba9a08-f902-4072-b1a6-631ea5056bc4 tempest-SnapshotDependencyTests-1963002193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:28:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-70ba9a08-f902-4072-b1a6-631ea5056bc4 tempest-SnapshotDependencyTests-1963002193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:28:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-70ba9a08-f902-4072-b1a6-631ea5056bc4 tempest-SnapshotDependencyTests-1963002193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:28:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-70ba9a08-f902-4072-b1a6-631ea5056bc4 tempest-SnapshotDependencyTests-1963002193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:28:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-70ba9a08-f902-4072-b1a6-631ea5056bc4 tempest-SnapshotDependencyTests-1963002193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-475d1029-1a49-4a90-b88d-b4eafbd2a701 tempest-SnapshotDependencyTests-1963002193 None] Acquiring lock "cinder-7325e10a-637a-4a46-af9a-026e82f8a3c6-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:00 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:29:00 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-475d1029-1a49-4a90-b88d-b4eafbd2a701 tempest-SnapshotDependencyTests-1963002193 None] Lock "cinder-7325e10a-637a-4a46-af9a-026e82f8a3c6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-475d1029-1a49-4a90-b88d-b4eafbd2a701 tempest-SnapshotDependencyTests-1963002193 None] Acquiring lock "cinder-quobyte-7325e10a-637a-4a46-af9a-026e82f8a3c6" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-475d1029-1a49-4a90-b88d-b4eafbd2a701 tempest-SnapshotDependencyTests-1963002193 None] Lock "cinder-quobyte-7325e10a-637a-4a46-af9a-026e82f8a3c6" acquired by "delete_volume" :: waited 0.022s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:00 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5dec1e-a3dd-4582-b10a-64fef488509d]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:00 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-475d1029-1a49-4a90-b88d-b4eafbd2a701 tempest-SnapshotDependencyTests-1963002193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7325e10a-637a-4a46-af9a-026e82f8a3c6 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2842ac91-f538-4d28-a6a6-e2943de59438 tempest-ProjectReaderTests-1186385509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-599e00b2-7774-438f-a1ae-0a031c01906d" returned: 0 in 0.539s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2842ac91-f538-4d28-a6a6-e2943de59438 tempest-ProjectReaderTests-1186385509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-599e00b2-7774-438f-a1ae-0a031c01906d {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:00 devstack sudo[108249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-599e00b2-7774-438f-a1ae-0a031c01906d Sep 28 18:29:00 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:00 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-84b37169-d2e9-4097-89d7-9b2793c5503a tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79.41a8c94e-3f1f-42aa-87bb-9223de3a019e" returned: 0 in 0.401s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:00 devstack sudo[108248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7325e10a-637a-4a46-af9a-026e82f8a3c6 Sep 28 18:29:00 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-84b37169-d2e9-4097-89d7-9b2793c5503a tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:00 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-70ba9a08-f902-4072-b1a6-631ea5056bc4 tempest-SnapshotDependencyTests-1963002193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.396s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:00 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-70ba9a08-f902-4072-b1a6-631ea5056bc4 tempest-SnapshotDependencyTests-1963002193 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:00 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-70ba9a08-f902-4072-b1a6-631ea5056bc4 tempest-SnapshotDependencyTests-1963002193 None] Deleted volume successfully. Sep 28 18:29:00 devstack sudo[108254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79.info Sep 28 18:29:00 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-70ba9a08-f902-4072-b1a6-631ea5056bc4 tempest-SnapshotDependencyTests-1963002193 None] Lock "cinder-ea50356d-0f63-4993-a5df-52bd54685d70-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:00 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2842ac91-f538-4d28-a6a6-e2943de59438 tempest-ProjectReaderTests-1186385509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-599e00b2-7774-438f-a1ae-0a031c01906d" returned: 0 in 0.383s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-2842ac91-f538-4d28-a6a6-e2943de59438 tempest-ProjectReaderTests-1186385509 None] Lock "cinder-quobyte-599e00b2-7774-438f-a1ae-0a031c01906d" released by "delete_volume" :: held 0.998s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:00 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-2842ac91-f538-4d28-a6a6-e2943de59438 tempest-ProjectReaderTests-1186385509 None] Created reservations ['6955e290-5ad5-4190-8507-164a500c7364', '9f8a8758-4851-4647-8712-1e08fb9b1c76', '4a3b3c3d-87f0-45d2-81e9-79a9e0dbc1a9', '8cad47f0-bf86-4fae-aae4-c6cbab4cd182'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:00 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-475d1029-1a49-4a90-b88d-b4eafbd2a701 tempest-SnapshotDependencyTests-1963002193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7325e10a-637a-4a46-af9a-026e82f8a3c6" returned: 0 in 0.554s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-475d1029-1a49-4a90-b88d-b4eafbd2a701 tempest-SnapshotDependencyTests-1963002193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7325e10a-637a-4a46-af9a-026e82f8a3c6 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:00 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7325e10a-637a-4a46-af9a-026e82f8a3c6 Sep 28 18:29:00 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:00 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-84b37169-d2e9-4097-89d7-9b2793c5503a tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79.info" returned: 0 in 0.441s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:00 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-84b37169-d2e9-4097-89d7-9b2793c5503a tempest-ProjectMemberTests-1075311172 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79.info is being set with open permissions: ugo+rw Sep 28 18:29:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-84b37169-d2e9-4097-89d7-9b2793c5503a tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:00 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79.info Sep 28 18:29:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2842ac91-f538-4d28-a6a6-e2943de59438 tempest-ProjectReaderTests-1186385509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2842ac91-f538-4d28-a6a6-e2943de59438 tempest-ProjectReaderTests-1186385509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2842ac91-f538-4d28-a6a6-e2943de59438 tempest-ProjectReaderTests-1186385509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:00 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2842ac91-f538-4d28-a6a6-e2943de59438 tempest-ProjectReaderTests-1186385509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2842ac91-f538-4d28-a6a6-e2943de59438 tempest-ProjectReaderTests-1186385509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2842ac91-f538-4d28-a6a6-e2943de59438 tempest-ProjectReaderTests-1186385509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:00 devstack sudo[108271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:29:00 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:01 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-475d1029-1a49-4a90-b88d-b4eafbd2a701 tempest-SnapshotDependencyTests-1963002193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7325e10a-637a-4a46-af9a-026e82f8a3c6" returned: 0 in 0.321s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-475d1029-1a49-4a90-b88d-b4eafbd2a701 tempest-SnapshotDependencyTests-1963002193 None] Lock "cinder-quobyte-7325e10a-637a-4a46-af9a-026e82f8a3c6" released by "delete_volume" :: held 0.939s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:01 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-84b37169-d2e9-4097-89d7-9b2793c5503a tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79.info" returned: 0 in 0.320s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:01 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-84b37169-d2e9-4097-89d7-9b2793c5503a tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.723s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2842ac91-f538-4d28-a6a6-e2943de59438 tempest-ProjectReaderTests-1186385509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.326s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:01 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-2842ac91-f538-4d28-a6a6-e2943de59438 tempest-ProjectReaderTests-1186385509 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:01 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-2842ac91-f538-4d28-a6a6-e2943de59438 tempest-ProjectReaderTests-1186385509 None] Deleted volume successfully. Sep 28 18:29:01 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-84b37169-d2e9-4097-89d7-9b2793c5503a tempest-ProjectMemberTests-1075311172 None] Create snapshot completed successfully Sep 28 18:29:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-2842ac91-f538-4d28-a6a6-e2943de59438 tempest-ProjectReaderTests-1186385509 None] Lock "cinder-599e00b2-7774-438f-a1ae-0a031c01906d-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:01 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-475d1029-1a49-4a90-b88d-b4eafbd2a701 tempest-SnapshotDependencyTests-1963002193 None] Created reservations ['2f4dbbae-7ab3-4ae0-869f-16cc31612d1c', 'e8b8c339-95e0-484c-8670-cfe8a8346493', 'efd83756-dd13-4ea3-a968-bc8c25a17a01', '8bf50f6a-7a31-4570-9c38-5c817cdab0c4'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-475d1029-1a49-4a90-b88d-b4eafbd2a701 tempest-SnapshotDependencyTests-1963002193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-475d1029-1a49-4a90-b88d-b4eafbd2a701 tempest-SnapshotDependencyTests-1963002193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-475d1029-1a49-4a90-b88d-b4eafbd2a701 tempest-SnapshotDependencyTests-1963002193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-475d1029-1a49-4a90-b88d-b4eafbd2a701 tempest-SnapshotDependencyTests-1963002193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-475d1029-1a49-4a90-b88d-b4eafbd2a701 tempest-SnapshotDependencyTests-1963002193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-475d1029-1a49-4a90-b88d-b4eafbd2a701 tempest-SnapshotDependencyTests-1963002193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:01 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:29:01 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-17bb0f75-d220-42cc-a48b-96a085865313 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-41a8c94e-3f1f-42aa-87bb-9223de3a019e-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:01 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-17bb0f75-d220-42cc-a48b-96a085865313 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-41a8c94e-3f1f-42aa-87bb-9223de3a019e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-17bb0f75-d220-42cc-a48b-96a085865313 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-quobyte-ebbd1a59-4b70-4dc2-992d-9e6484e04a79" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-475d1029-1a49-4a90-b88d-b4eafbd2a701 tempest-SnapshotDependencyTests-1963002193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.321s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:01 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-475d1029-1a49-4a90-b88d-b4eafbd2a701 tempest-SnapshotDependencyTests-1963002193 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:01 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-475d1029-1a49-4a90-b88d-b4eafbd2a701 tempest-SnapshotDependencyTests-1963002193 None] Deleted volume successfully. Sep 28 18:29:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-17bb0f75-d220-42cc-a48b-96a085865313 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-ebbd1a59-4b70-4dc2-992d-9e6484e04a79" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-17bb0f75-d220-42cc-a48b-96a085865313 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-quobyte-41a8c94e-3f1f-42aa-87bb-9223de3a019e" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-17bb0f75-d220-42cc-a48b-96a085865313 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-41a8c94e-3f1f-42aa-87bb-9223de3a019e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-17bb0f75-d220-42cc-a48b-96a085865313 tempest-ProjectMemberTests-1075311172 None] Deleting offline snapshot 41a8c94e-3f1f-42aa-87bb-9223de3a019e of volume ebbd1a59-4b70-4dc2-992d-9e6484e04a79 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:29:01 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-17bb0f75-d220-42cc-a48b-96a085865313 tempest-ProjectMemberTests-1075311172 None] snapshot_file for this snap is: volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79.41a8c94e-3f1f-42aa-87bb-9223de3a019e {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:29:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-475d1029-1a49-4a90-b88d-b4eafbd2a701 tempest-SnapshotDependencyTests-1963002193 None] Lock "cinder-7325e10a-637a-4a46-af9a-026e82f8a3c6-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:01 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e72538-07a2-44d9-b29a-e196d0961327]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-17bb0f75-d220-42cc-a48b-96a085865313 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79.41a8c94e-3f1f-42aa-87bb-9223de3a019e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:01 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79.41a8c94e-3f1f-42aa-87bb-9223de3a019e Sep 28 18:29:01 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:02 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-17bb0f75-d220-42cc-a48b-96a085865313 tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79.41a8c94e-3f1f-42aa-87bb-9223de3a019e" returned: 0 in 0.458s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-17bb0f75-d220-42cc-a48b-96a085865313 tempest-ProjectMemberTests-1075311172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:29:02 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fd59c4-1540-412a-81c5-749954eed255]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-17bb0f75-d220-42cc-a48b-96a085865313 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:02 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:29:02 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79 Sep 28 18:29:02 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Flow 'volume_create_manager' (5f0e3b69-d366-4a66-a422-1ae97b934189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8626a440-82b6-4bc2-a04d-083bdd49d742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8626a440-82b6-4bc2-a04d-083bdd49d742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-872790428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8438238c-bc6c-495d-94b1-7feef78346c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1948c9fc1164a59b35b4b7768aff4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:02Z,use_quota=True,user_id='cfbd883b39484aefa90aca900ddc3986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f69459-1c35-4962-b3ae-79d2f7b62942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f69459-1c35-4962-b3ae-79d2f7b62942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9197b297-bd95-4f18-89d9-8037f14ba7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9197b297-bd95-4f18-89d9-8037f14ba7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8438238c-bc6c-495d-94b1-7feef78346c5', 'volume_name': 'volume-8438238c-bc6c-495d-94b1-7feef78346c5', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5c058a-07f3-4a1a-9a64-21ad11ae5f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5c058a-07f3-4a1a-9a64-21ad11ae5f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96211af-77cb-446e-8be0-a2e34c73384a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:02 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Volume 8438238c-bc6c-495d-94b1-7feef78346c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8438238c-bc6c-495d-94b1-7feef78346c5', 'volume_size': 1} Sep 28 18:29:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-872790428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8438238c-bc6c-495d-94b1-7feef78346c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1948c9fc1164a59b35b4b7768aff4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:02Z,use_quota=True,user_id='cfbd883b39484aefa90aca900ddc3986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:29:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Creating volume 8438238c-bc6c-495d-94b1-7feef78346c5 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:29:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:29:02 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:29:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8438238c-bc6c-495d-94b1-7feef78346c5 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:02 devstack sudo[108287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8438238c-bc6c-495d-94b1-7feef78346c5 1073741824 Sep 28 18:29:02 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:02 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-17bb0f75-d220-42cc-a48b-96a085865313 tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79" returned: 0 in 0.475s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-17bb0f75-d220-42cc-a48b-96a085865313 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79.41a8c94e-3f1f-42aa-87bb-9223de3a019e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:02 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79.41a8c94e-3f1f-42aa-87bb-9223de3a019e Sep 28 18:29:02 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:03 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8438238c-bc6c-495d-94b1-7feef78346c5 1073741824" returned: 0 in 0.595s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8438238c-bc6c-495d-94b1-7feef78346c5 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:03 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8438238c-bc6c-495d-94b1-7feef78346c5 Sep 28 18:29:03 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:03 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-17bb0f75-d220-42cc-a48b-96a085865313 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79.41a8c94e-3f1f-42aa-87bb-9223de3a019e" returned: 0 in 0.482s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-17bb0f75-d220-42cc-a48b-96a085865313 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79.41a8c94e-3f1f-42aa-87bb-9223de3a019e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:03 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79.41a8c94e-3f1f-42aa-87bb-9223de3a019e Sep 28 18:29:03 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:03 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8438238c-bc6c-495d-94b1-7feef78346c5" returned: 0 in 0.338s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:29:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96211af-77cb-446e-8be0-a2e34c73384a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8438238c-bc6c-495d-94b1-7feef78346c5', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48befc5d-4c53-4566-8d39-2d04f98b4b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:03 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Volume volume-8438238c-bc6c-495d-94b1-7feef78346c5 (8438238c-bc6c-495d-94b1-7feef78346c5): created successfully Sep 28 18:29:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48befc5d-4c53-4566-8d39-2d04f98b4b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Flow 'volume_create_manager' (5f0e3b69-d366-4a66-a422-1ae97b934189) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:03 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-17bb0f75-d220-42cc-a48b-96a085865313 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79.41a8c94e-3f1f-42aa-87bb-9223de3a019e" returned: 0 in 0.321s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:03 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-77427f30-ed48-4348-a41d-0f806e30f6be tempest-ProjectReaderTests-1186385509 None] Created volume successfully. Sep 28 18:29:03 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-17bb0f75-d220-42cc-a48b-96a085865313 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-41a8c94e-3f1f-42aa-87bb-9223de3a019e" released by "_delete_snapshot" :: held 1.907s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:03 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-17bb0f75-d220-42cc-a48b-96a085865313 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-ebbd1a59-4b70-4dc2-992d-9e6484e04a79" released by "delete_snapshot" :: held 1.942s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:03 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-17bb0f75-d220-42cc-a48b-96a085865313 tempest-ProjectMemberTests-1075311172 None] Created reservations ['0c5ec38a-dd16-4be0-8e64-1367bc31ae0c', 'fd9c83ee-4651-4a5b-b8fa-27e45cf9bec4', 'a5f53038-00f9-4fb1-91cc-8a4e92ef8733', 'edf8b7e3-dd6b-4198-965b-1c5eacb0780c'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:03 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-17bb0f75-d220-42cc-a48b-96a085865313 tempest-ProjectMemberTests-1075311172 None] Delete snapshot completed successfully. Sep 28 18:29:03 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-17bb0f75-d220-42cc-a48b-96a085865313 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-41a8c94e-3f1f-42aa-87bb-9223de3a019e-delete_snapshot" released by "delete_snapshot" :: held 2.145s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:03 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1f585e3c-f7a7-4885-8c9f-e2f80dcba44c tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-ebbd1a59-4b70-4dc2-992d-9e6484e04a79-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:03 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1f585e3c-f7a7-4885-8c9f-e2f80dcba44c tempest-ProjectMemberTests-1075311172 None] Lock "cinder-ebbd1a59-4b70-4dc2-992d-9e6484e04a79-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:03 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1f585e3c-f7a7-4885-8c9f-e2f80dcba44c tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-quobyte-ebbd1a59-4b70-4dc2-992d-9e6484e04a79" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:03 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1f585e3c-f7a7-4885-8c9f-e2f80dcba44c tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-ebbd1a59-4b70-4dc2-992d-9e6484e04a79" acquired by "delete_volume" :: waited 0.032s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:03 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[99664b7c-dcd9-4ffb-b036-6b0bac2892a1]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1f585e3c-f7a7-4885-8c9f-e2f80dcba44c tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:04 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79 Sep 28 18:29:04 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:04 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1f585e3c-f7a7-4885-8c9f-e2f80dcba44c tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79" returned: 0 in 0.526s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1f585e3c-f7a7-4885-8c9f-e2f80dcba44c tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:04 devstack sudo[108350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79 Sep 28 18:29:04 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-88ca348c-bfd5-4100-844c-b652b603fe90 tempest-ProjectReaderTests-1186385509 None] Acquiring lock "cinder-8438238c-bc6c-495d-94b1-7feef78346c5-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:29:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-88ca348c-bfd5-4100-844c-b652b603fe90 tempest-ProjectReaderTests-1186385509 None] Lock "cinder-8438238c-bc6c-495d-94b1-7feef78346c5-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:04 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:29:04 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-88ca348c-bfd5-4100-844c-b652b603fe90 tempest-ProjectReaderTests-1186385509 None] Acquiring lock "cinder-quobyte-8438238c-bc6c-495d-94b1-7feef78346c5" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-88ca348c-bfd5-4100-844c-b652b603fe90 tempest-ProjectReaderTests-1186385509 None] Lock "cinder-quobyte-8438238c-bc6c-495d-94b1-7feef78346c5" acquired by "delete_volume" :: waited 0.030s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:04 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a74e5c-5ba5-4e77-9141-1714caf5b3a1]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-88ca348c-bfd5-4100-844c-b652b603fe90 tempest-ProjectReaderTests-1186385509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8438238c-bc6c-495d-94b1-7feef78346c5 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:04 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1f585e3c-f7a7-4885-8c9f-e2f80dcba44c tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ebbd1a59-4b70-4dc2-992d-9e6484e04a79" returned: 0 in 0.395s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:04 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8438238c-bc6c-495d-94b1-7feef78346c5 Sep 28 18:29:04 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:04 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1f585e3c-f7a7-4885-8c9f-e2f80dcba44c tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-ebbd1a59-4b70-4dc2-992d-9e6484e04a79" released by "delete_volume" :: held 1.033s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:05 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.427s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:05 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:05 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager._thread_info {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:29:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread count: 28 {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:29:05 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread info: [<_MainThread(MainThread, started 129097393381504)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:29:05 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-1f585e3c-f7a7-4885-8c9f-e2f80dcba44c tempest-ProjectMemberTests-1075311172 None] Created reservations ['5b6c13ed-dac8-48cd-8a58-c3f1d04a94a9', '60988b8e-8f6c-4fdf-b3f4-d2585256e1f8', 'a6ea14a3-44b5-4cc2-b939-437b851ba479', 'a7e83ada-a760-40b6-9314-d5f2c6e1590d'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1f585e3c-f7a7-4885-8c9f-e2f80dcba44c tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1f585e3c-f7a7-4885-8c9f-e2f80dcba44c tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1f585e3c-f7a7-4885-8c9f-e2f80dcba44c tempest-ProjectMemberTests-1075311172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-1f585e3c-f7a7-4885-8c9f-e2f80dcba44c tempest-ProjectMemberTests-1075311172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-1f585e3c-f7a7-4885-8c9f-e2f80dcba44c tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1f585e3c-f7a7-4885-8c9f-e2f80dcba44c tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:05 devstack sudo[108358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:29:05 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:05 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-88ca348c-bfd5-4100-844c-b652b603fe90 tempest-ProjectReaderTests-1186385509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8438238c-bc6c-495d-94b1-7feef78346c5" returned: 0 in 0.501s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-88ca348c-bfd5-4100-844c-b652b603fe90 tempest-ProjectReaderTests-1186385509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8438238c-bc6c-495d-94b1-7feef78346c5 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:05 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8438238c-bc6c-495d-94b1-7feef78346c5 Sep 28 18:29:05 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:05 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-1f585e3c-f7a7-4885-8c9f-e2f80dcba44c tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.330s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:05 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-1f585e3c-f7a7-4885-8c9f-e2f80dcba44c tempest-ProjectMemberTests-1075311172 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:05 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-1f585e3c-f7a7-4885-8c9f-e2f80dcba44c tempest-ProjectMemberTests-1075311172 None] Deleted volume successfully. Sep 28 18:29:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-1f585e3c-f7a7-4885-8c9f-e2f80dcba44c tempest-ProjectMemberTests-1075311172 None] Lock "cinder-ebbd1a59-4b70-4dc2-992d-9e6484e04a79-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:05 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-88ca348c-bfd5-4100-844c-b652b603fe90 tempest-ProjectReaderTests-1186385509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8438238c-bc6c-495d-94b1-7feef78346c5" returned: 0 in 0.312s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-88ca348c-bfd5-4100-844c-b652b603fe90 tempest-ProjectReaderTests-1186385509 None] Lock "cinder-quobyte-8438238c-bc6c-495d-94b1-7feef78346c5" released by "delete_volume" :: held 0.880s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:05 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-88ca348c-bfd5-4100-844c-b652b603fe90 tempest-ProjectReaderTests-1186385509 None] Created reservations ['a487d7f8-dbab-4193-b641-08d905cd68ec', 'e026536b-d793-499a-90c5-63f1be9e61eb', '6a5d28e6-5e97-4903-9bb4-346e84b73e32', '6ce4be80-1e5b-4a79-a009-05481c6b1365'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-88ca348c-bfd5-4100-844c-b652b603fe90 tempest-ProjectReaderTests-1186385509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-88ca348c-bfd5-4100-844c-b652b603fe90 tempest-ProjectReaderTests-1186385509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-88ca348c-bfd5-4100-844c-b652b603fe90 tempest-ProjectReaderTests-1186385509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-88ca348c-bfd5-4100-844c-b652b603fe90 tempest-ProjectReaderTests-1186385509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-88ca348c-bfd5-4100-844c-b652b603fe90 tempest-ProjectReaderTests-1186385509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-88ca348c-bfd5-4100-844c-b652b603fe90 tempest-ProjectReaderTests-1186385509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:05 devstack sudo[108368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:29:05 devstack sudo[108368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:06 devstack sudo[108368]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-88ca348c-bfd5-4100-844c-b652b603fe90 tempest-ProjectReaderTests-1186385509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.261s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:06 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-88ca348c-bfd5-4100-844c-b652b603fe90 tempest-ProjectReaderTests-1186385509 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:06 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-88ca348c-bfd5-4100-844c-b652b603fe90 tempest-ProjectReaderTests-1186385509 None] Deleted volume successfully. Sep 28 18:29:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-88ca348c-bfd5-4100-844c-b652b603fe90 tempest-ProjectReaderTests-1186385509 None] Lock "cinder-8438238c-bc6c-495d-94b1-7feef78346c5-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:06 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:29:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Flow 'volume_create_manager' (0c0d079f-c38d-4e26-89e9-9174f6f8a0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12b59b9-f47e-46e4-bb1a-5ab38a2f6a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12b59b9-f47e-46e4-bb1a-5ab38a2f6a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-203780755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9e99502d25421799dbe9850a9f19de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:07Z,use_quota=True,user_id='e2b01c6a248345f2a380ffc12b39bfb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d742d0d5-6a4b-4d72-822a-46b83c2326e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d742d0d5-6a4b-4d72-822a-46b83c2326e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52009206-befe-4667-a297-f0e855d6d1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52009206-befe-4667-a297-f0e855d6d1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa', 'volume_name': 'volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c639c086-eeba-429c-b0a0-07c6831343ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c639c086-eeba-429c-b0a0-07c6831343ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:06 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b4008e-a3e2-4d8d-991e-0a34a638c9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:06 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Volume eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa', 'volume_size': 1} Sep 28 18:29:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-203780755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9e99502d25421799dbe9850a9f19de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:07Z,use_quota=True,user_id='e2b01c6a248345f2a380ffc12b39bfb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:29:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Creating volume eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:29:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:06 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:29:06 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:29:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:06 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa 1073741824 Sep 28 18:29:06 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:07 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa 1073741824" returned: 0 in 0.665s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:07 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa Sep 28 18:29:07 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:07 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa" returned: 0 in 0.326s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:07 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:29:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b4008e-a3e2-4d8d-991e-0a34a638c9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e8fe0b-959e-4302-9c03-7abb4d023a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:07 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Volume volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa (eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa): created successfully Sep 28 18:29:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e8fe0b-959e-4302-9c03-7abb4d023a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:07 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Flow 'volume_create_manager' (0c0d079f-c38d-4e26-89e9-9174f6f8a0da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:07 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-8ca3842e-4121-4370-80ec-ee9bb8774f21 tempest-ProjectMemberTests-1075311172 None] Created volume successfully. Sep 28 18:29:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-56d3b221-1402-4866-9b1e-57e99b153caa tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-56d3b221-1402-4866-9b1e-57e99b153caa tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-56d3b221-1402-4866-9b1e-57e99b153caa tempest-ProjectMemberTests-1075311172 None] Creating offline snapshot 3e298ebb-54d2-4ea3-9193-c0077fbe24f8 of volume eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:29:09 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[736f11a3-7f11-404b-b925-0f21f52ae6c6]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-56d3b221-1402-4866-9b1e-57e99b153caa tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:09 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa Sep 28 18:29:09 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:09 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-56d3b221-1402-4866-9b1e-57e99b153caa tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa" returned: 0 in 0.477s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-56d3b221-1402-4866-9b1e-57e99b153caa tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa.3e298ebb-54d2-4ea3-9193-c0077fbe24f8 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:09 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa.3e298ebb-54d2-4ea3-9193-c0077fbe24f8 1G Sep 28 18:29:09 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:10 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-56d3b221-1402-4866-9b1e-57e99b153caa tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa.3e298ebb-54d2-4ea3-9193-c0077fbe24f8 1G" returned: 0 in 0.597s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-56d3b221-1402-4866-9b1e-57e99b153caa tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa.3e298ebb-54d2-4ea3-9193-c0077fbe24f8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:10 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa.3e298ebb-54d2-4ea3-9193-c0077fbe24f8 Sep 28 18:29:10 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:10 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-56d3b221-1402-4866-9b1e-57e99b153caa tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa.3e298ebb-54d2-4ea3-9193-c0077fbe24f8" returned: 0 in 0.421s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:10 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-56d3b221-1402-4866-9b1e-57e99b153caa tempest-ProjectMemberTests-1075311172 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa.3e298ebb-54d2-4ea3-9193-c0077fbe24f8 is being set with open permissions: ugo+rw Sep 28 18:29:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-56d3b221-1402-4866-9b1e-57e99b153caa tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa.3e298ebb-54d2-4ea3-9193-c0077fbe24f8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:10 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa.3e298ebb-54d2-4ea3-9193-c0077fbe24f8 Sep 28 18:29:10 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:11 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-56d3b221-1402-4866-9b1e-57e99b153caa tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa.3e298ebb-54d2-4ea3-9193-c0077fbe24f8" returned: 0 in 0.340s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-56d3b221-1402-4866-9b1e-57e99b153caa tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:11 devstack sudo[108401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa.info Sep 28 18:29:11 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:11 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-56d3b221-1402-4866-9b1e-57e99b153caa tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa.info" returned: 0 in 0.296s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:11 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-56d3b221-1402-4866-9b1e-57e99b153caa tempest-ProjectMemberTests-1075311172 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa.info is being set with open permissions: ugo+rw Sep 28 18:29:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-56d3b221-1402-4866-9b1e-57e99b153caa tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:11 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa.info Sep 28 18:29:11 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:11 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-56d3b221-1402-4866-9b1e-57e99b153caa tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa.info" returned: 0 in 0.309s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-56d3b221-1402-4866-9b1e-57e99b153caa tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.561s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:11 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-56d3b221-1402-4866-9b1e-57e99b153caa tempest-ProjectMemberTests-1075311172 None] Create snapshot completed successfully Sep 28 18:29:12 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4b62f053-e201-4f7d-8cba-d94e81f3a9bb tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-3e298ebb-54d2-4ea3-9193-c0077fbe24f8-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:12 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4b62f053-e201-4f7d-8cba-d94e81f3a9bb tempest-ProjectMemberTests-1075311172 None] Lock "cinder-3e298ebb-54d2-4ea3-9193-c0077fbe24f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:12 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4b62f053-e201-4f7d-8cba-d94e81f3a9bb tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-quobyte-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:12 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4b62f053-e201-4f7d-8cba-d94e81f3a9bb tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:12 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4b62f053-e201-4f7d-8cba-d94e81f3a9bb tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-quobyte-3e298ebb-54d2-4ea3-9193-c0077fbe24f8" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:12 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4b62f053-e201-4f7d-8cba-d94e81f3a9bb tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-3e298ebb-54d2-4ea3-9193-c0077fbe24f8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:12 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-4b62f053-e201-4f7d-8cba-d94e81f3a9bb tempest-ProjectMemberTests-1075311172 None] Deleting offline snapshot 3e298ebb-54d2-4ea3-9193-c0077fbe24f8 of volume eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:29:12 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-4b62f053-e201-4f7d-8cba-d94e81f3a9bb tempest-ProjectMemberTests-1075311172 None] snapshot_file for this snap is: volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa.3e298ebb-54d2-4ea3-9193-c0077fbe24f8 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:29:12 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a603a7d-a974-4b9a-9cd8-db24320fbf6f]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4b62f053-e201-4f7d-8cba-d94e81f3a9bb tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa.3e298ebb-54d2-4ea3-9193-c0077fbe24f8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:12 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa.3e298ebb-54d2-4ea3-9193-c0077fbe24f8 Sep 28 18:29:12 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:12 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4b62f053-e201-4f7d-8cba-d94e81f3a9bb tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa.3e298ebb-54d2-4ea3-9193-c0077fbe24f8" returned: 0 in 0.498s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:12 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-4b62f053-e201-4f7d-8cba-d94e81f3a9bb tempest-ProjectMemberTests-1075311172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:29:12 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61e1d97-1958-45dc-864b-97e01870a7fd]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4b62f053-e201-4f7d-8cba-d94e81f3a9bb tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:13 devstack sudo[108413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa Sep 28 18:29:13 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:13 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4b62f053-e201-4f7d-8cba-d94e81f3a9bb tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa" returned: 0 in 0.570s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4b62f053-e201-4f7d-8cba-d94e81f3a9bb tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa.3e298ebb-54d2-4ea3-9193-c0077fbe24f8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:13 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa.3e298ebb-54d2-4ea3-9193-c0077fbe24f8 Sep 28 18:29:13 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:14 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4b62f053-e201-4f7d-8cba-d94e81f3a9bb tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa.3e298ebb-54d2-4ea3-9193-c0077fbe24f8" returned: 0 in 0.481s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4b62f053-e201-4f7d-8cba-d94e81f3a9bb tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa.3e298ebb-54d2-4ea3-9193-c0077fbe24f8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:14 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa.3e298ebb-54d2-4ea3-9193-c0077fbe24f8 Sep 28 18:29:14 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:14 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4b62f053-e201-4f7d-8cba-d94e81f3a9bb tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa.3e298ebb-54d2-4ea3-9193-c0077fbe24f8" returned: 0 in 0.360s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:14 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4b62f053-e201-4f7d-8cba-d94e81f3a9bb tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-3e298ebb-54d2-4ea3-9193-c0077fbe24f8" released by "_delete_snapshot" :: held 2.096s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:14 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4b62f053-e201-4f7d-8cba-d94e81f3a9bb tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa" released by "delete_snapshot" :: held 2.146s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:14 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-4b62f053-e201-4f7d-8cba-d94e81f3a9bb tempest-ProjectMemberTests-1075311172 None] Created reservations ['1c7b4d81-4321-4457-a3be-d4493533969f', '48e478e3-5358-4865-8e02-46dbc69c9716', 'd4fb9943-7744-44ff-b134-da789293609e', '320b3c54-82cd-4fb4-abac-2fa8c5cdb9a7'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:14 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-4b62f053-e201-4f7d-8cba-d94e81f3a9bb tempest-ProjectMemberTests-1075311172 None] Delete snapshot completed successfully. Sep 28 18:29:14 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4b62f053-e201-4f7d-8cba-d94e81f3a9bb tempest-ProjectMemberTests-1075311172 None] Lock "cinder-3e298ebb-54d2-4ea3-9193-c0077fbe24f8-delete_snapshot" released by "delete_snapshot" :: held 2.417s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:15 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3779082f-62bf-4bf8-85b5-5b1ee98c1de8 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:15 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3779082f-62bf-4bf8-85b5-5b1ee98c1de8 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:15 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3779082f-62bf-4bf8-85b5-5b1ee98c1de8 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-quobyte-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:15 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3779082f-62bf-4bf8-85b5-5b1ee98c1de8 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa" acquired by "delete_volume" :: waited 0.025s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:15 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[abebd449-566f-4cd5-80f9-6ea41f835568]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3779082f-62bf-4bf8-85b5-5b1ee98c1de8 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:16 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa Sep 28 18:29:16 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:16 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3779082f-62bf-4bf8-85b5-5b1ee98c1de8 tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa" returned: 0 in 0.452s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3779082f-62bf-4bf8-85b5-5b1ee98c1de8 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:16 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa Sep 28 18:29:16 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:16 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3779082f-62bf-4bf8-85b5-5b1ee98c1de8 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa" returned: 0 in 0.349s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:16 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3779082f-62bf-4bf8-85b5-5b1ee98c1de8 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa" released by "delete_volume" :: held 0.908s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:16 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-3779082f-62bf-4bf8-85b5-5b1ee98c1de8 tempest-ProjectMemberTests-1075311172 None] Created reservations ['db8f5b95-fcc8-456b-805b-fbffae37bdc1', '9eb18af7-8fe5-4997-ac8c-88d33533f698', '08432059-faa1-4d4d-8f35-02781eecc2b0', '4b6cede9-3706-458f-a659-d9977e452c74'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3779082f-62bf-4bf8-85b5-5b1ee98c1de8 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3779082f-62bf-4bf8-85b5-5b1ee98c1de8 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3779082f-62bf-4bf8-85b5-5b1ee98c1de8 tempest-ProjectMemberTests-1075311172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:16 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3779082f-62bf-4bf8-85b5-5b1ee98c1de8 tempest-ProjectMemberTests-1075311172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3779082f-62bf-4bf8-85b5-5b1ee98c1de8 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3779082f-62bf-4bf8-85b5-5b1ee98c1de8 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:16 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:29:16 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:17 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3779082f-62bf-4bf8-85b5-5b1ee98c1de8 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.385s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:17 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-3779082f-62bf-4bf8-85b5-5b1ee98c1de8 tempest-ProjectMemberTests-1075311172 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:17 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-3779082f-62bf-4bf8-85b5-5b1ee98c1de8 tempest-ProjectMemberTests-1075311172 None] Deleted volume successfully. Sep 28 18:29:17 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3779082f-62bf-4bf8-85b5-5b1ee98c1de8 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-eb0a8065-4623-4ef9-b8dc-7d9fc22a4daa-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:17 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:29:17 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Flow 'volume_create_manager' (94a4878f-2f1c-4e87-a20f-edac67aace66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:17 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef20077-9969-4307-918d-f6ad0999ec02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:17 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef20077-9969-4307-918d-f6ad0999ec02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1246908291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0c21bc8-020b-4fd2-a613-ecab91c3227a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9e99502d25421799dbe9850a9f19de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:18Z,use_quota=True,user_id='e2b01c6a248345f2a380ffc12b39bfb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:17 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd7e25dd-8ea8-42e3-80e1-3462187d7d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:17 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd7e25dd-8ea8-42e3-80e1-3462187d7d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:17 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d294ae-a5fe-4f6c-960e-2fc808048088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:17 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d294ae-a5fe-4f6c-960e-2fc808048088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0c21bc8-020b-4fd2-a613-ecab91c3227a', 'volume_name': 'volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:17 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d32acf3-2ff1-4fad-8ee0-81b3264c4098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:17 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d32acf3-2ff1-4fad-8ee0-81b3264c4098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:17 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9096afa3-303d-473d-8b13-76f8dab356e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:17 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Volume b0c21bc8-020b-4fd2-a613-ecab91c3227a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a', 'volume_size': 1} Sep 28 18:29:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:17 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1246908291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0c21bc8-020b-4fd2-a613-ecab91c3227a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9e99502d25421799dbe9850a9f19de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:18Z,use_quota=True,user_id='e2b01c6a248345f2a380ffc12b39bfb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:29:17 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Creating volume b0c21bc8-020b-4fd2-a613-ecab91c3227a {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:29:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:17 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:17 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:17 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:29:17 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:29:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:17 devstack sudo[108439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a 1073741824 Sep 28 18:29:17 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:18 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a 1073741824" returned: 0 in 0.580s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:18 devstack sudo[108445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a Sep 28 18:29:18 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:18 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a" returned: 0 in 0.282s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:18 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:29:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9096afa3-303d-473d-8b13-76f8dab356e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b7ed92-8d51-4738-a024-3ba2ee2bc31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:18 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Volume volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a (b0c21bc8-020b-4fd2-a613-ecab91c3227a): created successfully Sep 28 18:29:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b7ed92-8d51-4738-a024-3ba2ee2bc31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:18 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Flow 'volume_create_manager' (94a4878f-2f1c-4e87-a20f-edac67aace66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:18 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-a7c4c4dd-c52e-4fe1-9666-5f678e072399 tempest-ProjectMemberTests-1075311172 None] Created volume successfully. Sep 28 18:29:19 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:DELETE=18,cinder:SELECT=145,cinder:INSERT=54,cinder:UPDATE=199 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:29:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-36d3665c-d12c-43cc-8400-1220428f9910 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-36d3665c-d12c-43cc-8400-1220428f9910 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:19 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-36d3665c-d12c-43cc-8400-1220428f9910 tempest-ProjectMemberTests-1075311172 None] Creating offline snapshot 4464a56a-245e-466d-a2a6-1da1d718b44b of volume b0c21bc8-020b-4fd2-a613-ecab91c3227a {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:29:19 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb10b9f-1189-4fca-9497-4f571065e2a3]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:19 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-36d3665c-d12c-43cc-8400-1220428f9910 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:20 devstack sudo[108448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a Sep 28 18:29:20 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:20 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-36d3665c-d12c-43cc-8400-1220428f9910 tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a" returned: 0 in 0.384s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-36d3665c-d12c-43cc-8400-1220428f9910 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a.4464a56a-245e-466d-a2a6-1da1d718b44b 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:20 devstack sudo[108453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a.4464a56a-245e-466d-a2a6-1da1d718b44b 1G Sep 28 18:29:20 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:20 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-36d3665c-d12c-43cc-8400-1220428f9910 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a.4464a56a-245e-466d-a2a6-1da1d718b44b 1G" returned: 0 in 0.513s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:20 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-36d3665c-d12c-43cc-8400-1220428f9910 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a.4464a56a-245e-466d-a2a6-1da1d718b44b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:20 devstack sudo[108459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a.4464a56a-245e-466d-a2a6-1da1d718b44b Sep 28 18:29:20 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:21 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-36d3665c-d12c-43cc-8400-1220428f9910 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a.4464a56a-245e-466d-a2a6-1da1d718b44b" returned: 0 in 0.360s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:21 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-36d3665c-d12c-43cc-8400-1220428f9910 tempest-ProjectMemberTests-1075311172 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a.4464a56a-245e-466d-a2a6-1da1d718b44b is being set with open permissions: ugo+rw Sep 28 18:29:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-36d3665c-d12c-43cc-8400-1220428f9910 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a.4464a56a-245e-466d-a2a6-1da1d718b44b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:21 devstack sudo[108465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a.4464a56a-245e-466d-a2a6-1da1d718b44b Sep 28 18:29:21 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:21 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-36d3665c-d12c-43cc-8400-1220428f9910 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a.4464a56a-245e-466d-a2a6-1da1d718b44b" returned: 0 in 0.299s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:21 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=150,cinder:UPDATE=187,cinder:INSERT=53,cinder:DELETE=13 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:29:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-36d3665c-d12c-43cc-8400-1220428f9910 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:21 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a.info Sep 28 18:29:21 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:21 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-36d3665c-d12c-43cc-8400-1220428f9910 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a.info" returned: 0 in 0.253s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:21 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-36d3665c-d12c-43cc-8400-1220428f9910 tempest-ProjectMemberTests-1075311172 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a.info is being set with open permissions: ugo+rw Sep 28 18:29:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-36d3665c-d12c-43cc-8400-1220428f9910 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:21 devstack sudo[108472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a.info Sep 28 18:29:21 devstack sudo[108472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:21 devstack sudo[108472]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-36d3665c-d12c-43cc-8400-1220428f9910 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a.info" returned: 0 in 0.251s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-36d3665c-d12c-43cc-8400-1220428f9910 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.158s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:22 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-36d3665c-d12c-43cc-8400-1220428f9910 tempest-ProjectMemberTests-1075311172 None] Create snapshot completed successfully Sep 28 18:29:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cc5b75fa-6203-45e5-8b43-adb3ddc2ab46 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-4464a56a-245e-466d-a2a6-1da1d718b44b-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cc5b75fa-6203-45e5-8b43-adb3ddc2ab46 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-4464a56a-245e-466d-a2a6-1da1d718b44b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cc5b75fa-6203-45e5-8b43-adb3ddc2ab46 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-quobyte-b0c21bc8-020b-4fd2-a613-ecab91c3227a" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cc5b75fa-6203-45e5-8b43-adb3ddc2ab46 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-b0c21bc8-020b-4fd2-a613-ecab91c3227a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cc5b75fa-6203-45e5-8b43-adb3ddc2ab46 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-quobyte-4464a56a-245e-466d-a2a6-1da1d718b44b" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cc5b75fa-6203-45e5-8b43-adb3ddc2ab46 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-4464a56a-245e-466d-a2a6-1da1d718b44b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-cc5b75fa-6203-45e5-8b43-adb3ddc2ab46 tempest-ProjectMemberTests-1075311172 None] Deleting offline snapshot 4464a56a-245e-466d-a2a6-1da1d718b44b of volume b0c21bc8-020b-4fd2-a613-ecab91c3227a {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:29:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-cc5b75fa-6203-45e5-8b43-adb3ddc2ab46 tempest-ProjectMemberTests-1075311172 None] snapshot_file for this snap is: volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a.4464a56a-245e-466d-a2a6-1da1d718b44b {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:29:23 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb6a500-4768-4dc3-ab57-4580bee786b8]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc5b75fa-6203-45e5-8b43-adb3ddc2ab46 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a.4464a56a-245e-466d-a2a6-1da1d718b44b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:23 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a.4464a56a-245e-466d-a2a6-1da1d718b44b Sep 28 18:29:23 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:23 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc5b75fa-6203-45e5-8b43-adb3ddc2ab46 tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a.4464a56a-245e-466d-a2a6-1da1d718b44b" returned: 0 in 0.402s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-cc5b75fa-6203-45e5-8b43-adb3ddc2ab46 tempest-ProjectMemberTests-1075311172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:29:23 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bfe6d8-6063-4b18-ae9d-1fea82db27ae]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc5b75fa-6203-45e5-8b43-adb3ddc2ab46 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:23 devstack sudo[108480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a Sep 28 18:29:23 devstack sudo[108480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:23 devstack sudo[108480]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc5b75fa-6203-45e5-8b43-adb3ddc2ab46 tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a" returned: 0 in 0.392s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc5b75fa-6203-45e5-8b43-adb3ddc2ab46 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a.4464a56a-245e-466d-a2a6-1da1d718b44b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:23 devstack sudo[108485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a.4464a56a-245e-466d-a2a6-1da1d718b44b Sep 28 18:29:23 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:24 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc5b75fa-6203-45e5-8b43-adb3ddc2ab46 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a.4464a56a-245e-466d-a2a6-1da1d718b44b" returned: 0 in 0.339s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc5b75fa-6203-45e5-8b43-adb3ddc2ab46 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a.4464a56a-245e-466d-a2a6-1da1d718b44b {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:24 devstack sudo[108491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a.4464a56a-245e-466d-a2a6-1da1d718b44b Sep 28 18:29:24 devstack sudo[108491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:24 devstack sudo[108491]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cc5b75fa-6203-45e5-8b43-adb3ddc2ab46 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a.4464a56a-245e-466d-a2a6-1da1d718b44b" returned: 0 in 0.262s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:24 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cc5b75fa-6203-45e5-8b43-adb3ddc2ab46 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-4464a56a-245e-466d-a2a6-1da1d718b44b" released by "_delete_snapshot" :: held 1.498s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:24 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cc5b75fa-6203-45e5-8b43-adb3ddc2ab46 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-b0c21bc8-020b-4fd2-a613-ecab91c3227a" released by "delete_snapshot" :: held 1.519s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:24 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-cc5b75fa-6203-45e5-8b43-adb3ddc2ab46 tempest-ProjectMemberTests-1075311172 None] Created reservations ['af4614a9-57cc-4033-b76b-6e9b863122d2', 'ad6ce6bf-92fe-42ae-bc48-09c6d91bb575', 'a4995faa-b481-4438-8931-ec4caf63c0cb', 'cc0484b6-a9bb-4f40-be53-4ea6fa0ed676'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:24 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-cc5b75fa-6203-45e5-8b43-adb3ddc2ab46 tempest-ProjectMemberTests-1075311172 None] Delete snapshot completed successfully. Sep 28 18:29:24 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-cc5b75fa-6203-45e5-8b43-adb3ddc2ab46 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-4464a56a-245e-466d-a2a6-1da1d718b44b-delete_snapshot" released by "delete_snapshot" :: held 1.673s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:25 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3beaf337-97b1-483f-beb3-62fd797abed9 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-b0c21bc8-020b-4fd2-a613-ecab91c3227a-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:25 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3beaf337-97b1-483f-beb3-62fd797abed9 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-b0c21bc8-020b-4fd2-a613-ecab91c3227a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:25 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3beaf337-97b1-483f-beb3-62fd797abed9 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-quobyte-b0c21bc8-020b-4fd2-a613-ecab91c3227a" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:25 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3beaf337-97b1-483f-beb3-62fd797abed9 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-b0c21bc8-020b-4fd2-a613-ecab91c3227a" acquired by "delete_volume" :: waited 0.015s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:25 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fe9198-14bf-4b16-8435-aece7da37827]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3beaf337-97b1-483f-beb3-62fd797abed9 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:25 devstack sudo[108494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a Sep 28 18:29:25 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:25 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3beaf337-97b1-483f-beb3-62fd797abed9 tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a" returned: 0 in 0.401s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3beaf337-97b1-483f-beb3-62fd797abed9 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:25 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a Sep 28 18:29:25 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:26 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3beaf337-97b1-483f-beb3-62fd797abed9 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-b0c21bc8-020b-4fd2-a613-ecab91c3227a" returned: 0 in 0.308s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:26 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3beaf337-97b1-483f-beb3-62fd797abed9 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-b0c21bc8-020b-4fd2-a613-ecab91c3227a" released by "delete_volume" :: held 0.787s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:26 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-3beaf337-97b1-483f-beb3-62fd797abed9 tempest-ProjectMemberTests-1075311172 None] Created reservations ['bd294b4d-e23e-461d-ad5b-fefcb5c0a67e', 'b3dc92c5-33d7-4ff0-9142-8ba261bc8cfd', 'a4617a85-18bb-481e-965a-90edccd0bdfc', 'cf5f5bf3-764c-4492-8d91-5975ad184348'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3beaf337-97b1-483f-beb3-62fd797abed9 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3beaf337-97b1-483f-beb3-62fd797abed9 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:26 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3beaf337-97b1-483f-beb3-62fd797abed9 tempest-ProjectMemberTests-1075311172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:26 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3beaf337-97b1-483f-beb3-62fd797abed9 tempest-ProjectMemberTests-1075311172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3beaf337-97b1-483f-beb3-62fd797abed9 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3beaf337-97b1-483f-beb3-62fd797abed9 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:26 devstack sudo[108502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:29:26 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:26 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3beaf337-97b1-483f-beb3-62fd797abed9 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.303s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:26 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-3beaf337-97b1-483f-beb3-62fd797abed9 tempest-ProjectMemberTests-1075311172 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:26 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-3beaf337-97b1-483f-beb3-62fd797abed9 tempest-ProjectMemberTests-1075311172 None] Deleted volume successfully. Sep 28 18:29:26 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3beaf337-97b1-483f-beb3-62fd797abed9 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-b0c21bc8-020b-4fd2-a613-ecab91c3227a-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:26 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:29:26 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Flow 'volume_create_manager' (b53973f6-3561-4510-bdd3-35927b0412d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:26 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca8872b7-8365-4ab3-a57b-a7274b12e4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:27 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca8872b7-8365-4ab3-a57b-a7274b12e4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-44018663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca054966-7ea0-4c7c-bbd2-4f9198a09418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9e99502d25421799dbe9850a9f19de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:27Z,use_quota=True,user_id='e2b01c6a248345f2a380ffc12b39bfb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:27 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72e53a3d-2c49-4140-9f5d-f35680db9c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:27 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72e53a3d-2c49-4140-9f5d-f35680db9c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:27 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba373594-6059-437d-bced-6542ce9704f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:27 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba373594-6059-437d-bced-6542ce9704f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca054966-7ea0-4c7c-bbd2-4f9198a09418', 'volume_name': 'volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:27 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acf482be-6d82-4212-9ee0-3355ea6b9a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:27 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acf482be-6d82-4212-9ee0-3355ea6b9a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:27 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa829fb-2e16-4299-aec1-3d9a9ff5cedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:27 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Volume ca054966-7ea0-4c7c-bbd2-4f9198a09418: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418', 'volume_size': 1} Sep 28 18:29:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-44018663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca054966-7ea0-4c7c-bbd2-4f9198a09418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9e99502d25421799dbe9850a9f19de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:27Z,use_quota=True,user_id='e2b01c6a248345f2a380ffc12b39bfb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:29:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Creating volume ca054966-7ea0-4c7c-bbd2-4f9198a09418 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:29:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:29:27 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:29:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:27 devstack sudo[108505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418 1073741824 Sep 28 18:29:27 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:27 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418 1073741824" returned: 0 in 0.483s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:27 devstack sudo[108511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418 Sep 28 18:29:27 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:27 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418" returned: 0 in 0.254s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:29:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:27 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa829fb-2e16-4299-aec1-3d9a9ff5cedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:27 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13231895-7ded-4bc0-b67a-af074acff392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:27 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Volume volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418 (ca054966-7ea0-4c7c-bbd2-4f9198a09418): created successfully Sep 28 18:29:27 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13231895-7ded-4bc0-b67a-af074acff392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:27 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Flow 'volume_create_manager' (b53973f6-3561-4510-bdd3-35927b0412d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:27 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-0490a576-ea18-4ab5-93b7-694a0a71df9f tempest-ProjectMemberTests-1075311172 None] Created volume successfully. Sep 28 18:29:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-475be04d-01b4-4224-b613-848717c9c69a tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-475be04d-01b4-4224-b613-848717c9c69a tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:29 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-475be04d-01b4-4224-b613-848717c9c69a tempest-ProjectMemberTests-1075311172 None] Creating offline snapshot 59d8c58a-cdad-404d-8e2d-61a47cea3013 of volume ca054966-7ea0-4c7c-bbd2-4f9198a09418 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:29:29 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd45b4a-68ed-439f-a3f9-6b28f9f46294]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-475be04d-01b4-4224-b613-848717c9c69a tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:29 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418 Sep 28 18:29:29 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:29 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-475be04d-01b4-4224-b613-848717c9c69a tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418" returned: 0 in 0.370s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-475be04d-01b4-4224-b613-848717c9c69a tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418.59d8c58a-cdad-404d-8e2d-61a47cea3013 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:29 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418.59d8c58a-cdad-404d-8e2d-61a47cea3013 1G Sep 28 18:29:29 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:30 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-475be04d-01b4-4224-b613-848717c9c69a tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418.59d8c58a-cdad-404d-8e2d-61a47cea3013 1G" returned: 0 in 0.416s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-475be04d-01b4-4224-b613-848717c9c69a tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418.59d8c58a-cdad-404d-8e2d-61a47cea3013 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:30 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418.59d8c58a-cdad-404d-8e2d-61a47cea3013 Sep 28 18:29:30 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:30 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-475be04d-01b4-4224-b613-848717c9c69a tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418.59d8c58a-cdad-404d-8e2d-61a47cea3013" returned: 0 in 0.330s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:30 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-475be04d-01b4-4224-b613-848717c9c69a tempest-ProjectMemberTests-1075311172 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418.59d8c58a-cdad-404d-8e2d-61a47cea3013 is being set with open permissions: ugo+rw Sep 28 18:29:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-475be04d-01b4-4224-b613-848717c9c69a tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418.59d8c58a-cdad-404d-8e2d-61a47cea3013 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:30 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418.59d8c58a-cdad-404d-8e2d-61a47cea3013 Sep 28 18:29:30 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:30 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-475be04d-01b4-4224-b613-848717c9c69a tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418.59d8c58a-cdad-404d-8e2d-61a47cea3013" returned: 0 in 0.267s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-475be04d-01b4-4224-b613-848717c9c69a tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:30 devstack sudo[108532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418.info Sep 28 18:29:30 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:31 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-475be04d-01b4-4224-b613-848717c9c69a tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418.info" returned: 0 in 0.277s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:31 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-475be04d-01b4-4224-b613-848717c9c69a tempest-ProjectMemberTests-1075311172 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418.info is being set with open permissions: ugo+rw Sep 28 18:29:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-475be04d-01b4-4224-b613-848717c9c69a tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:31 devstack sudo[108535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418.info Sep 28 18:29:31 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:31 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-475be04d-01b4-4224-b613-848717c9c69a tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418.info" returned: 0 in 0.302s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-475be04d-01b4-4224-b613-848717c9c69a tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.063s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:31 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-475be04d-01b4-4224-b613-848717c9c69a tempest-ProjectMemberTests-1075311172 None] Create snapshot completed successfully Sep 28 18:29:32 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-316d5792-60d4-4aae-a57c-b65888b8250a tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-59d8c58a-cdad-404d-8e2d-61a47cea3013-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:32 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-316d5792-60d4-4aae-a57c-b65888b8250a tempest-ProjectMemberTests-1075311172 None] Lock "cinder-59d8c58a-cdad-404d-8e2d-61a47cea3013-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:32 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-316d5792-60d4-4aae-a57c-b65888b8250a tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-quobyte-ca054966-7ea0-4c7c-bbd2-4f9198a09418" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:32 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-316d5792-60d4-4aae-a57c-b65888b8250a tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-ca054966-7ea0-4c7c-bbd2-4f9198a09418" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:32 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-316d5792-60d4-4aae-a57c-b65888b8250a tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-quobyte-59d8c58a-cdad-404d-8e2d-61a47cea3013" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:32 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-316d5792-60d4-4aae-a57c-b65888b8250a tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-59d8c58a-cdad-404d-8e2d-61a47cea3013" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:32 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-316d5792-60d4-4aae-a57c-b65888b8250a tempest-ProjectMemberTests-1075311172 None] Deleting offline snapshot 59d8c58a-cdad-404d-8e2d-61a47cea3013 of volume ca054966-7ea0-4c7c-bbd2-4f9198a09418 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:29:32 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-316d5792-60d4-4aae-a57c-b65888b8250a tempest-ProjectMemberTests-1075311172 None] snapshot_file for this snap is: volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418.59d8c58a-cdad-404d-8e2d-61a47cea3013 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:29:32 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ee884e-c954-4b25-b0c4-76197f965e8b]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-316d5792-60d4-4aae-a57c-b65888b8250a tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418.59d8c58a-cdad-404d-8e2d-61a47cea3013 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:32 devstack sudo[108539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418.59d8c58a-cdad-404d-8e2d-61a47cea3013 Sep 28 18:29:32 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:32 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-316d5792-60d4-4aae-a57c-b65888b8250a tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418.59d8c58a-cdad-404d-8e2d-61a47cea3013" returned: 0 in 0.399s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:32 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-316d5792-60d4-4aae-a57c-b65888b8250a tempest-ProjectMemberTests-1075311172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:29:32 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2d457e-3382-4ef6-bb28-41e2110c484d]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:32 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-316d5792-60d4-4aae-a57c-b65888b8250a tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:33 devstack sudo[108544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418 Sep 28 18:29:33 devstack sudo[108544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:33 devstack sudo[108544]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-316d5792-60d4-4aae-a57c-b65888b8250a tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418" returned: 0 in 0.379s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-316d5792-60d4-4aae-a57c-b65888b8250a tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418.59d8c58a-cdad-404d-8e2d-61a47cea3013 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:33 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418.59d8c58a-cdad-404d-8e2d-61a47cea3013 Sep 28 18:29:33 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:33 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-316d5792-60d4-4aae-a57c-b65888b8250a tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418.59d8c58a-cdad-404d-8e2d-61a47cea3013" returned: 0 in 0.371s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-316d5792-60d4-4aae-a57c-b65888b8250a tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418.59d8c58a-cdad-404d-8e2d-61a47cea3013 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:33 devstack sudo[108554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418.59d8c58a-cdad-404d-8e2d-61a47cea3013 Sep 28 18:29:33 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:34 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-316d5792-60d4-4aae-a57c-b65888b8250a tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418.59d8c58a-cdad-404d-8e2d-61a47cea3013" returned: 0 in 0.276s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:34 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-316d5792-60d4-4aae-a57c-b65888b8250a tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-59d8c58a-cdad-404d-8e2d-61a47cea3013" released by "_delete_snapshot" :: held 1.534s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:34 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-316d5792-60d4-4aae-a57c-b65888b8250a tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-ca054966-7ea0-4c7c-bbd2-4f9198a09418" released by "delete_snapshot" :: held 1.564s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:34 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-316d5792-60d4-4aae-a57c-b65888b8250a tempest-ProjectMemberTests-1075311172 None] Created reservations ['df78f80d-5fc5-472e-88b5-91d8e75108a3', '608bf88c-f2ea-456f-9ed8-d262566c1e9c', '988ebc7c-b879-4372-b670-37ff69d817b5', '3e50dd43-5fe8-4bd6-963b-83161f55c590'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:34 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-316d5792-60d4-4aae-a57c-b65888b8250a tempest-ProjectMemberTests-1075311172 None] Delete snapshot completed successfully. Sep 28 18:29:34 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-316d5792-60d4-4aae-a57c-b65888b8250a tempest-ProjectMemberTests-1075311172 None] Lock "cinder-59d8c58a-cdad-404d-8e2d-61a47cea3013-delete_snapshot" released by "delete_snapshot" :: held 1.720s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:34 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ca2e1e78-e49e-4013-bafe-93b1a959ba62 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-ca054966-7ea0-4c7c-bbd2-4f9198a09418-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:34 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ca2e1e78-e49e-4013-bafe-93b1a959ba62 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-ca054966-7ea0-4c7c-bbd2-4f9198a09418-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:34 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ca2e1e78-e49e-4013-bafe-93b1a959ba62 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-quobyte-ca054966-7ea0-4c7c-bbd2-4f9198a09418" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:34 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ca2e1e78-e49e-4013-bafe-93b1a959ba62 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-ca054966-7ea0-4c7c-bbd2-4f9198a09418" acquired by "delete_volume" :: waited 0.029s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:34 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b151b57a-661c-42a8-b048-af4827e258d7]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ca2e1e78-e49e-4013-bafe-93b1a959ba62 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:34 devstack sudo[108557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418 Sep 28 18:29:34 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:35 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ca2e1e78-e49e-4013-bafe-93b1a959ba62 tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418" returned: 0 in 0.444s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ca2e1e78-e49e-4013-bafe-93b1a959ba62 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:35 devstack sudo[108563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418 Sep 28 18:29:35 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:35 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ca2e1e78-e49e-4013-bafe-93b1a959ba62 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-ca054966-7ea0-4c7c-bbd2-4f9198a09418" returned: 0 in 0.250s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:35 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ca2e1e78-e49e-4013-bafe-93b1a959ba62 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-ca054966-7ea0-4c7c-bbd2-4f9198a09418" released by "delete_volume" :: held 0.779s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:35 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-ca2e1e78-e49e-4013-bafe-93b1a959ba62 tempest-ProjectMemberTests-1075311172 None] Created reservations ['a649fd70-73c5-42ac-9753-6f6305236767', 'ff39c66c-3776-4d06-aeda-a699407179e7', '308b8790-ecea-4289-8a8a-9200b3878768', '4fd0d0f1-d2a8-4535-9568-e556cb7bd177'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ca2e1e78-e49e-4013-bafe-93b1a959ba62 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ca2e1e78-e49e-4013-bafe-93b1a959ba62 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:35 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ca2e1e78-e49e-4013-bafe-93b1a959ba62 tempest-ProjectMemberTests-1075311172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:35 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ca2e1e78-e49e-4013-bafe-93b1a959ba62 tempest-ProjectMemberTests-1075311172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ca2e1e78-e49e-4013-bafe-93b1a959ba62 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ca2e1e78-e49e-4013-bafe-93b1a959ba62 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:35 devstack sudo[108566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:29:35 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:35 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ca2e1e78-e49e-4013-bafe-93b1a959ba62 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.257s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:35 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-ca2e1e78-e49e-4013-bafe-93b1a959ba62 tempest-ProjectMemberTests-1075311172 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:35 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-ca2e1e78-e49e-4013-bafe-93b1a959ba62 tempest-ProjectMemberTests-1075311172 None] Deleted volume successfully. Sep 28 18:29:35 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ca2e1e78-e49e-4013-bafe-93b1a959ba62 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-ca054966-7ea0-4c7c-bbd2-4f9198a09418-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:36 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:29:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Flow 'volume_create_manager' (307b1a03-51ea-4acf-999f-6a9e705ea421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff3a517-95ff-4cd2-a6fa-38ca69dd7bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff3a517-95ff-4cd2-a6fa-38ca69dd7bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-57261079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f06144b-d957-4286-aeda-f6363cd6fd42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9e99502d25421799dbe9850a9f19de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:36Z,use_quota=True,user_id='e2b01c6a248345f2a380ffc12b39bfb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb95d7d-cc30-44ae-8140-01537aeef4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb95d7d-cc30-44ae-8140-01537aeef4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50bc0314-36fb-4432-be5a-7f533cad3b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50bc0314-36fb-4432-be5a-7f533cad3b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f06144b-d957-4286-aeda-f6363cd6fd42', 'volume_name': 'volume-8f06144b-d957-4286-aeda-f6363cd6fd42', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (105cac15-8bfe-480a-b37b-df15745f0a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (105cac15-8bfe-480a-b37b-df15745f0a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:36 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4caeea36-a38c-4faf-8eda-03fb455e21ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:36 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Volume 8f06144b-d957-4286-aeda-f6363cd6fd42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f06144b-d957-4286-aeda-f6363cd6fd42', 'volume_size': 1} Sep 28 18:29:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-57261079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f06144b-d957-4286-aeda-f6363cd6fd42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9e99502d25421799dbe9850a9f19de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:36Z,use_quota=True,user_id='e2b01c6a248345f2a380ffc12b39bfb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:29:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Creating volume 8f06144b-d957-4286-aeda-f6363cd6fd42 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:29:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:29:36 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:29:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:36 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42 1073741824 Sep 28 18:29:36 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:36 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42 1073741824" returned: 0 in 0.433s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:36 devstack sudo[108574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42 Sep 28 18:29:36 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:37 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42" returned: 0 in 0.257s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:29:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4caeea36-a38c-4faf-8eda-03fb455e21ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f06144b-d957-4286-aeda-f6363cd6fd42', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e23adaf-6627-488f-ac38-853770a298c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:37 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Volume volume-8f06144b-d957-4286-aeda-f6363cd6fd42 (8f06144b-d957-4286-aeda-f6363cd6fd42): created successfully Sep 28 18:29:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e23adaf-6627-488f-ac38-853770a298c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:37 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Flow 'volume_create_manager' (307b1a03-51ea-4acf-999f-6a9e705ea421) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:37 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-6be9fe4d-faf0-4c66-81df-9b2a8c5909b0 tempest-ProjectMemberTests-1075311172 None] Created volume successfully. Sep 28 18:29:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7e910982-28e8-4db7-a734-8a6360168ace tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7e910982-28e8-4db7-a734-8a6360168ace tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-7e910982-28e8-4db7-a734-8a6360168ace tempest-ProjectMemberTests-1075311172 None] Creating offline snapshot 21e58dff-25b7-48ec-b5af-280b2e3b85ad of volume 8f06144b-d957-4286-aeda-f6363cd6fd42 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:29:37 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e3b8b3-5560-45a2-94ec-812e556478c1]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7e910982-28e8-4db7-a734-8a6360168ace tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:37 devstack sudo[108577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42 Sep 28 18:29:37 devstack sudo[108577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:37 devstack sudo[108577]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7e910982-28e8-4db7-a734-8a6360168ace tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42" returned: 0 in 0.369s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7e910982-28e8-4db7-a734-8a6360168ace tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42.21e58dff-25b7-48ec-b5af-280b2e3b85ad 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:37 devstack sudo[108582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42.21e58dff-25b7-48ec-b5af-280b2e3b85ad 1G Sep 28 18:29:37 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:38 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7e910982-28e8-4db7-a734-8a6360168ace tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42.21e58dff-25b7-48ec-b5af-280b2e3b85ad 1G" returned: 0 in 0.395s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7e910982-28e8-4db7-a734-8a6360168ace tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f06144b-d957-4286-aeda-f6363cd6fd42 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42.21e58dff-25b7-48ec-b5af-280b2e3b85ad {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:38 devstack sudo[108587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f06144b-d957-4286-aeda-f6363cd6fd42 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42.21e58dff-25b7-48ec-b5af-280b2e3b85ad Sep 28 18:29:38 devstack sudo[108587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:38 devstack sudo[108587]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7e910982-28e8-4db7-a734-8a6360168ace tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f06144b-d957-4286-aeda-f6363cd6fd42 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42.21e58dff-25b7-48ec-b5af-280b2e3b85ad" returned: 0 in 0.285s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:38 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-7e910982-28e8-4db7-a734-8a6360168ace tempest-ProjectMemberTests-1075311172 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42.21e58dff-25b7-48ec-b5af-280b2e3b85ad is being set with open permissions: ugo+rw Sep 28 18:29:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7e910982-28e8-4db7-a734-8a6360168ace tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42.21e58dff-25b7-48ec-b5af-280b2e3b85ad {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:38 devstack sudo[108592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42.21e58dff-25b7-48ec-b5af-280b2e3b85ad Sep 28 18:29:38 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:38 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7e910982-28e8-4db7-a734-8a6360168ace tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42.21e58dff-25b7-48ec-b5af-280b2e3b85ad" returned: 0 in 0.250s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7e910982-28e8-4db7-a734-8a6360168ace tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:38 devstack sudo[108595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42.info Sep 28 18:29:38 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:39 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7e910982-28e8-4db7-a734-8a6360168ace tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42.info" returned: 0 in 0.264s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:39 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-7e910982-28e8-4db7-a734-8a6360168ace tempest-ProjectMemberTests-1075311172 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42.info is being set with open permissions: ugo+rw Sep 28 18:29:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7e910982-28e8-4db7-a734-8a6360168ace tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:39 devstack sudo[108598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42.info Sep 28 18:29:39 devstack sudo[108598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:39 devstack sudo[108598]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-7e910982-28e8-4db7-a734-8a6360168ace tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42.info" returned: 0 in 0.250s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-7e910982-28e8-4db7-a734-8a6360168ace tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.898s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:39 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-7e910982-28e8-4db7-a734-8a6360168ace tempest-ProjectMemberTests-1075311172 None] Create snapshot completed successfully Sep 28 18:29:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4697e004-94b8-480e-a8c1-15f28feae79f tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-21e58dff-25b7-48ec-b5af-280b2e3b85ad-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4697e004-94b8-480e-a8c1-15f28feae79f tempest-ProjectMemberTests-1075311172 None] Lock "cinder-21e58dff-25b7-48ec-b5af-280b2e3b85ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4697e004-94b8-480e-a8c1-15f28feae79f tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-quobyte-8f06144b-d957-4286-aeda-f6363cd6fd42" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4697e004-94b8-480e-a8c1-15f28feae79f tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-8f06144b-d957-4286-aeda-f6363cd6fd42" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4697e004-94b8-480e-a8c1-15f28feae79f tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-quobyte-21e58dff-25b7-48ec-b5af-280b2e3b85ad" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4697e004-94b8-480e-a8c1-15f28feae79f tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-21e58dff-25b7-48ec-b5af-280b2e3b85ad" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-4697e004-94b8-480e-a8c1-15f28feae79f tempest-ProjectMemberTests-1075311172 None] Deleting offline snapshot 21e58dff-25b7-48ec-b5af-280b2e3b85ad of volume 8f06144b-d957-4286-aeda-f6363cd6fd42 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:29:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-4697e004-94b8-480e-a8c1-15f28feae79f tempest-ProjectMemberTests-1075311172 None] snapshot_file for this snap is: volume-8f06144b-d957-4286-aeda-f6363cd6fd42.21e58dff-25b7-48ec-b5af-280b2e3b85ad {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:29:39 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e8841a-64d2-428f-b5c1-5bae5c467887]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4697e004-94b8-480e-a8c1-15f28feae79f tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42.21e58dff-25b7-48ec-b5af-280b2e3b85ad {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:39 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42.21e58dff-25b7-48ec-b5af-280b2e3b85ad Sep 28 18:29:39 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:40 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4697e004-94b8-480e-a8c1-15f28feae79f tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42.21e58dff-25b7-48ec-b5af-280b2e3b85ad" returned: 0 in 0.381s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:40 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-4697e004-94b8-480e-a8c1-15f28feae79f tempest-ProjectMemberTests-1075311172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f06144b-d957-4286-aeda-f6363cd6fd42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:29:40 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c206cef-6ead-46d6-8b6c-429079d5957b]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4697e004-94b8-480e-a8c1-15f28feae79f tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:40 devstack sudo[108606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42 Sep 28 18:29:40 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:40 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4697e004-94b8-480e-a8c1-15f28feae79f tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42" returned: 0 in 0.376s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4697e004-94b8-480e-a8c1-15f28feae79f tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42.21e58dff-25b7-48ec-b5af-280b2e3b85ad {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:40 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42.21e58dff-25b7-48ec-b5af-280b2e3b85ad Sep 28 18:29:40 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:40 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4697e004-94b8-480e-a8c1-15f28feae79f tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42.21e58dff-25b7-48ec-b5af-280b2e3b85ad" returned: 0 in 0.353s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4697e004-94b8-480e-a8c1-15f28feae79f tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42.21e58dff-25b7-48ec-b5af-280b2e3b85ad {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:40 devstack sudo[108616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42.21e58dff-25b7-48ec-b5af-280b2e3b85ad Sep 28 18:29:40 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:41 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4697e004-94b8-480e-a8c1-15f28feae79f tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42.21e58dff-25b7-48ec-b5af-280b2e3b85ad" returned: 0 in 0.261s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4697e004-94b8-480e-a8c1-15f28feae79f tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-21e58dff-25b7-48ec-b5af-280b2e3b85ad" released by "_delete_snapshot" :: held 1.475s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4697e004-94b8-480e-a8c1-15f28feae79f tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-8f06144b-d957-4286-aeda-f6363cd6fd42" released by "delete_snapshot" :: held 1.500s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:41 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-4697e004-94b8-480e-a8c1-15f28feae79f tempest-ProjectMemberTests-1075311172 None] Created reservations ['7a8b2b3c-1e57-4c07-a227-5d9ebe63b3c7', 'e93b3d29-1865-472e-83a1-a60a0ee9bbf3', 'b76986c4-356a-421a-a3f3-5c173d1fcc51', '41ceb751-11cf-484e-b16a-f77742b8805c'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:41 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-4697e004-94b8-480e-a8c1-15f28feae79f tempest-ProjectMemberTests-1075311172 None] Delete snapshot completed successfully. Sep 28 18:29:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4697e004-94b8-480e-a8c1-15f28feae79f tempest-ProjectMemberTests-1075311172 None] Lock "cinder-21e58dff-25b7-48ec-b5af-280b2e3b85ad-delete_snapshot" released by "delete_snapshot" :: held 1.657s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-884a27ec-bef7-489a-ab73-d8c7533b2248 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-8f06144b-d957-4286-aeda-f6363cd6fd42-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-884a27ec-bef7-489a-ab73-d8c7533b2248 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-8f06144b-d957-4286-aeda-f6363cd6fd42-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-884a27ec-bef7-489a-ab73-d8c7533b2248 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-quobyte-8f06144b-d957-4286-aeda-f6363cd6fd42" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:41 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-884a27ec-bef7-489a-ab73-d8c7533b2248 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-8f06144b-d957-4286-aeda-f6363cd6fd42" acquired by "delete_volume" :: waited 0.016s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:41 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0b63be-9fb6-451b-b511-d71fc092b0b7]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-884a27ec-bef7-489a-ab73-d8c7533b2248 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:42 devstack sudo[108620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42 Sep 28 18:29:42 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:42 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-884a27ec-bef7-489a-ab73-d8c7533b2248 tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42" returned: 0 in 0.404s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-884a27ec-bef7-489a-ab73-d8c7533b2248 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:42 devstack sudo[108626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42 Sep 28 18:29:42 devstack sudo[108626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:42 devstack sudo[108626]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-884a27ec-bef7-489a-ab73-d8c7533b2248 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8f06144b-d957-4286-aeda-f6363cd6fd42" returned: 0 in 0.257s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:42 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-884a27ec-bef7-489a-ab73-d8c7533b2248 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-8f06144b-d957-4286-aeda-f6363cd6fd42" released by "delete_volume" :: held 0.727s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:42 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-884a27ec-bef7-489a-ab73-d8c7533b2248 tempest-ProjectMemberTests-1075311172 None] Created reservations ['0270d94d-4764-46f8-ac00-e7aecb3e30c2', 'e258ac5d-c1de-4ae9-aeb9-6b3fa38d9394', 'cbf88f8a-c4b4-42a3-9ad6-481d45b6d139', '25546aa5-6926-48f5-aa84-77069ac4a278'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-884a27ec-bef7-489a-ab73-d8c7533b2248 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-884a27ec-bef7-489a-ab73-d8c7533b2248 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-884a27ec-bef7-489a-ab73-d8c7533b2248 tempest-ProjectMemberTests-1075311172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-884a27ec-bef7-489a-ab73-d8c7533b2248 tempest-ProjectMemberTests-1075311172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-884a27ec-bef7-489a-ab73-d8c7533b2248 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-884a27ec-bef7-489a-ab73-d8c7533b2248 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:42 devstack sudo[108630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:29:42 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:43 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-884a27ec-bef7-489a-ab73-d8c7533b2248 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.266s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:43 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-884a27ec-bef7-489a-ab73-d8c7533b2248 tempest-ProjectMemberTests-1075311172 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:43 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-884a27ec-bef7-489a-ab73-d8c7533b2248 tempest-ProjectMemberTests-1075311172 None] Deleted volume successfully. Sep 28 18:29:43 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-884a27ec-bef7-489a-ab73-d8c7533b2248 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-8f06144b-d957-4286-aeda-f6363cd6fd42-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:43 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:29:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Flow 'volume_create_manager' (78e1ea88-7ded-4ddc-b986-9281e0f1b1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96249205-ec84-4d3a-bc17-e2f94d39aabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96249205-ec84-4d3a-bc17-e2f94d39aabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1807421774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0faf9be1-7439-4a4a-a571-65bd26341e97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9e99502d25421799dbe9850a9f19de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:43Z,use_quota=True,user_id='e2b01c6a248345f2a380ffc12b39bfb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85fd8c07-a515-44b0-8c4c-47ec94140b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85fd8c07-a515-44b0-8c4c-47ec94140b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54785a12-54fe-498d-a688-8c2931054757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54785a12-54fe-498d-a688-8c2931054757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0faf9be1-7439-4a4a-a571-65bd26341e97', 'volume_name': 'volume-0faf9be1-7439-4a4a-a571-65bd26341e97', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a98ea89-223a-4151-9357-94cf77ffd343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a98ea89-223a-4151-9357-94cf77ffd343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:43 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd742969-58ac-4bc5-932d-19a991020020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:43 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Volume 0faf9be1-7439-4a4a-a571-65bd26341e97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0faf9be1-7439-4a4a-a571-65bd26341e97', 'volume_size': 1} Sep 28 18:29:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1807421774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0faf9be1-7439-4a4a-a571-65bd26341e97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9e99502d25421799dbe9850a9f19de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:43Z,use_quota=True,user_id='e2b01c6a248345f2a380ffc12b39bfb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:29:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Creating volume 0faf9be1-7439-4a4a-a571-65bd26341e97 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:29:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:43 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:29:43 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:29:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:43 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97 1073741824 Sep 28 18:29:43 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:44 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97 1073741824" returned: 0 in 0.492s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:44 devstack sudo[108639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97 Sep 28 18:29:44 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:44 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97" returned: 0 in 0.290s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:44 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:29:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd742969-58ac-4bc5-932d-19a991020020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0faf9be1-7439-4a4a-a571-65bd26341e97', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7117a3d-74f8-4095-8dfa-fcfe32a3f90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:44 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Volume volume-0faf9be1-7439-4a4a-a571-65bd26341e97 (0faf9be1-7439-4a4a-a571-65bd26341e97): created successfully Sep 28 18:29:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7117a3d-74f8-4095-8dfa-fcfe32a3f90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:44 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Flow 'volume_create_manager' (78e1ea88-7ded-4ddc-b986-9281e0f1b1ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:44 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-951df996-18b8-49ed-aaba-56f619705ca0 tempest-ProjectMemberTests-1075311172 None] Created volume successfully. Sep 28 18:29:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a7be372e-507a-46a8-9084-f5015f5c8d61 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a7be372e-507a-46a8-9084-f5015f5c8d61 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:45 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-a7be372e-507a-46a8-9084-f5015f5c8d61 tempest-ProjectMemberTests-1075311172 None] Creating offline snapshot 9c4ce36f-6224-46f1-9d93-769fdb526b8f of volume 0faf9be1-7439-4a4a-a571-65bd26341e97 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:29:45 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd1018f-0cc8-4e13-bf0d-9146feabcc5f]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:45 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a7be372e-507a-46a8-9084-f5015f5c8d61 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:45 devstack sudo[108644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97 Sep 28 18:29:45 devstack sudo[108644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:46 devstack sudo[108644]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a7be372e-507a-46a8-9084-f5015f5c8d61 tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97" returned: 0 in 0.412s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a7be372e-507a-46a8-9084-f5015f5c8d61 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97.9c4ce36f-6224-46f1-9d93-769fdb526b8f 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:46 devstack sudo[108649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97.9c4ce36f-6224-46f1-9d93-769fdb526b8f 1G Sep 28 18:29:46 devstack sudo[108649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:46 devstack sudo[108649]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a7be372e-507a-46a8-9084-f5015f5c8d61 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97.9c4ce36f-6224-46f1-9d93-769fdb526b8f 1G" returned: 0 in 0.430s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a7be372e-507a-46a8-9084-f5015f5c8d61 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0faf9be1-7439-4a4a-a571-65bd26341e97 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97.9c4ce36f-6224-46f1-9d93-769fdb526b8f {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:46 devstack sudo[108655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0faf9be1-7439-4a4a-a571-65bd26341e97 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97.9c4ce36f-6224-46f1-9d93-769fdb526b8f Sep 28 18:29:46 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:47 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a7be372e-507a-46a8-9084-f5015f5c8d61 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0faf9be1-7439-4a4a-a571-65bd26341e97 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97.9c4ce36f-6224-46f1-9d93-769fdb526b8f" returned: 0 in 0.331s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:47 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-a7be372e-507a-46a8-9084-f5015f5c8d61 tempest-ProjectMemberTests-1075311172 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97.9c4ce36f-6224-46f1-9d93-769fdb526b8f is being set with open permissions: ugo+rw Sep 28 18:29:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a7be372e-507a-46a8-9084-f5015f5c8d61 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97.9c4ce36f-6224-46f1-9d93-769fdb526b8f {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:47 devstack sudo[108660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97.9c4ce36f-6224-46f1-9d93-769fdb526b8f Sep 28 18:29:47 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:47 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a7be372e-507a-46a8-9084-f5015f5c8d61 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97.9c4ce36f-6224-46f1-9d93-769fdb526b8f" returned: 0 in 0.274s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a7be372e-507a-46a8-9084-f5015f5c8d61 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:47 devstack sudo[108663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97.info Sep 28 18:29:47 devstack sudo[108663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:47 devstack sudo[108663]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a7be372e-507a-46a8-9084-f5015f5c8d61 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97.info" returned: 0 in 0.285s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:47 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-a7be372e-507a-46a8-9084-f5015f5c8d61 tempest-ProjectMemberTests-1075311172 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97.info is being set with open permissions: ugo+rw Sep 28 18:29:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a7be372e-507a-46a8-9084-f5015f5c8d61 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:47 devstack sudo[108666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97.info Sep 28 18:29:47 devstack sudo[108666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:47 devstack sudo[108666]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a7be372e-507a-46a8-9084-f5015f5c8d61 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97.info" returned: 0 in 0.293s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a7be372e-507a-46a8-9084-f5015f5c8d61 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.131s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:47 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-a7be372e-507a-46a8-9084-f5015f5c8d61 tempest-ProjectMemberTests-1075311172 None] Create snapshot completed successfully Sep 28 18:29:48 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4e7803d4-b21d-4467-b7e8-18bec2df6727 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-9c4ce36f-6224-46f1-9d93-769fdb526b8f-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:49 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4e7803d4-b21d-4467-b7e8-18bec2df6727 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-9c4ce36f-6224-46f1-9d93-769fdb526b8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:49 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4e7803d4-b21d-4467-b7e8-18bec2df6727 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-quobyte-0faf9be1-7439-4a4a-a571-65bd26341e97" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:49 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4e7803d4-b21d-4467-b7e8-18bec2df6727 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-0faf9be1-7439-4a4a-a571-65bd26341e97" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:49 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4e7803d4-b21d-4467-b7e8-18bec2df6727 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-quobyte-9c4ce36f-6224-46f1-9d93-769fdb526b8f" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:49 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4e7803d4-b21d-4467-b7e8-18bec2df6727 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-9c4ce36f-6224-46f1-9d93-769fdb526b8f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-4e7803d4-b21d-4467-b7e8-18bec2df6727 tempest-ProjectMemberTests-1075311172 None] Deleting offline snapshot 9c4ce36f-6224-46f1-9d93-769fdb526b8f of volume 0faf9be1-7439-4a4a-a571-65bd26341e97 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:29:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-4e7803d4-b21d-4467-b7e8-18bec2df6727 tempest-ProjectMemberTests-1075311172 None] snapshot_file for this snap is: volume-0faf9be1-7439-4a4a-a571-65bd26341e97.9c4ce36f-6224-46f1-9d93-769fdb526b8f {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:29:49 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5332c1-f498-4525-afc3-9efb3f3c19b2]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4e7803d4-b21d-4467-b7e8-18bec2df6727 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97.9c4ce36f-6224-46f1-9d93-769fdb526b8f {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:49 devstack sudo[108669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97.9c4ce36f-6224-46f1-9d93-769fdb526b8f Sep 28 18:29:49 devstack sudo[108669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:49 devstack sudo[108669]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4e7803d4-b21d-4467-b7e8-18bec2df6727 tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97.9c4ce36f-6224-46f1-9d93-769fdb526b8f" returned: 0 in 0.399s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-4e7803d4-b21d-4467-b7e8-18bec2df6727 tempest-ProjectMemberTests-1075311172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0faf9be1-7439-4a4a-a571-65bd26341e97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:29:49 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac306b9-1bfa-4a39-945b-e98d093625e7]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4e7803d4-b21d-4467-b7e8-18bec2df6727 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:49 devstack sudo[108674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97 Sep 28 18:29:49 devstack sudo[108674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:49 devstack sudo[108674]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4e7803d4-b21d-4467-b7e8-18bec2df6727 tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97" returned: 0 in 0.402s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4e7803d4-b21d-4467-b7e8-18bec2df6727 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97.9c4ce36f-6224-46f1-9d93-769fdb526b8f {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:49 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97.9c4ce36f-6224-46f1-9d93-769fdb526b8f Sep 28 18:29:49 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:50 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4e7803d4-b21d-4467-b7e8-18bec2df6727 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97.9c4ce36f-6224-46f1-9d93-769fdb526b8f" returned: 0 in 0.368s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4e7803d4-b21d-4467-b7e8-18bec2df6727 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97.9c4ce36f-6224-46f1-9d93-769fdb526b8f {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:50 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97.9c4ce36f-6224-46f1-9d93-769fdb526b8f Sep 28 18:29:50 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:50 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-4e7803d4-b21d-4467-b7e8-18bec2df6727 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97.9c4ce36f-6224-46f1-9d93-769fdb526b8f" returned: 0 in 0.283s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:50 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4e7803d4-b21d-4467-b7e8-18bec2df6727 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-9c4ce36f-6224-46f1-9d93-769fdb526b8f" released by "_delete_snapshot" :: held 1.555s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:50 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4e7803d4-b21d-4467-b7e8-18bec2df6727 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-0faf9be1-7439-4a4a-a571-65bd26341e97" released by "delete_snapshot" :: held 1.578s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:50 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-4e7803d4-b21d-4467-b7e8-18bec2df6727 tempest-ProjectMemberTests-1075311172 None] Created reservations ['488d8839-a9d3-452c-acf2-bea74ce37494', '8160e2c1-51a5-4c30-9d82-267f90e13e52', 'ef87e683-5227-4942-b40c-7dce48397e92', '84932228-5e5c-4f88-bc37-8b5e16c1f64b'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:50 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-4e7803d4-b21d-4467-b7e8-18bec2df6727 tempest-ProjectMemberTests-1075311172 None] Delete snapshot completed successfully. Sep 28 18:29:50 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-4e7803d4-b21d-4467-b7e8-18bec2df6727 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-9c4ce36f-6224-46f1-9d93-769fdb526b8f-delete_snapshot" released by "delete_snapshot" :: held 1.735s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:51 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b87a1309-a4fd-4b1f-bf06-0c60983f21d9 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-0faf9be1-7439-4a4a-a571-65bd26341e97-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:51 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b87a1309-a4fd-4b1f-bf06-0c60983f21d9 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-0faf9be1-7439-4a4a-a571-65bd26341e97-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:51 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b87a1309-a4fd-4b1f-bf06-0c60983f21d9 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-quobyte-0faf9be1-7439-4a4a-a571-65bd26341e97" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:51 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b87a1309-a4fd-4b1f-bf06-0c60983f21d9 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-0faf9be1-7439-4a4a-a571-65bd26341e97" acquired by "delete_volume" :: waited 0.016s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:51 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9168049e-7fc0-4a67-a5a3-ac800fa01d67]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b87a1309-a4fd-4b1f-bf06-0c60983f21d9 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:51 devstack sudo[108688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97 Sep 28 18:29:51 devstack sudo[108688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:51 devstack sudo[108688]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b87a1309-a4fd-4b1f-bf06-0c60983f21d9 tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97" returned: 0 in 0.391s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b87a1309-a4fd-4b1f-bf06-0c60983f21d9 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:51 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97 Sep 28 18:29:51 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:51 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:51 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b87a1309-a4fd-4b1f-bf06-0c60983f21d9 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-0faf9be1-7439-4a4a-a571-65bd26341e97" returned: 0 in 0.255s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:51 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b87a1309-a4fd-4b1f-bf06-0c60983f21d9 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-0faf9be1-7439-4a4a-a571-65bd26341e97" released by "delete_volume" :: held 0.705s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-b87a1309-a4fd-4b1f-bf06-0c60983f21d9 tempest-ProjectMemberTests-1075311172 None] Created reservations ['c60ff34c-19d5-4bfb-a1c1-37f3f333de2b', 'de3c3813-8a11-40c2-911d-d1631bc94f3c', '76bad5c1-5c95-4a8b-a760-61de9b0385b8', 'd47efec4-d38b-473c-9973-c9e9640b59f3'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b87a1309-a4fd-4b1f-bf06-0c60983f21d9 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b87a1309-a4fd-4b1f-bf06-0c60983f21d9 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b87a1309-a4fd-4b1f-bf06-0c60983f21d9 tempest-ProjectMemberTests-1075311172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-b87a1309-a4fd-4b1f-bf06-0c60983f21d9 tempest-ProjectMemberTests-1075311172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-b87a1309-a4fd-4b1f-bf06-0c60983f21d9 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b87a1309-a4fd-4b1f-bf06-0c60983f21d9 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:52 devstack sudo[108697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:29:52 devstack sudo[108697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:52 devstack sudo[108697]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b87a1309-a4fd-4b1f-bf06-0c60983f21d9 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.263s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-b87a1309-a4fd-4b1f-bf06-0c60983f21d9 tempest-ProjectMemberTests-1075311172 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:52 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-b87a1309-a4fd-4b1f-bf06-0c60983f21d9 tempest-ProjectMemberTests-1075311172 None] Deleted volume successfully. Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b87a1309-a4fd-4b1f-bf06-0c60983f21d9 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-0faf9be1-7439-4a4a-a571-65bd26341e97-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Flow 'volume_create_manager' (ecf9ca13-9fe5-494a-a4a2-86296dc1c2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99318a77-2078-41d2-b6ff-0ad871a5c19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99318a77-2078-41d2-b6ff-0ad871a5c19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-368904601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a791c4-45a9-408a-82f5-7ddb9d6972f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9e99502d25421799dbe9850a9f19de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:53Z,use_quota=True,user_id='e2b01c6a248345f2a380ffc12b39bfb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41968f75-9939-4840-a696-311964ea1b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41968f75-9939-4840-a696-311964ea1b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949f8ede-9df7-4b05-aee3-ff7f0b86d734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949f8ede-9df7-4b05-aee3-ff7f0b86d734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0a791c4-45a9-408a-82f5-7ddb9d6972f1', 'volume_name': 'volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00a603a-e336-4db2-98a1-f0ff6e5edbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00a603a-e336-4db2-98a1-f0ff6e5edbfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4f498d-1a45-4def-bc42-81300402e58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:52 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Volume c0a791c4-45a9-408a-82f5-7ddb9d6972f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1', 'volume_size': 1} Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-368904601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a791c4-45a9-408a-82f5-7ddb9d6972f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9e99502d25421799dbe9850a9f19de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:29:53Z,use_quota=True,user_id='e2b01c6a248345f2a380ffc12b39bfb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Creating volume c0a791c4-45a9-408a-82f5-7ddb9d6972f1 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:29:52 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:29:52 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:52 devstack sudo[108700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1 1073741824 Sep 28 18:29:52 devstack sudo[108700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:53 devstack sudo[108700]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1 1073741824" returned: 0 in 0.453s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:53 devstack sudo[108705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1 Sep 28 18:29:53 devstack sudo[108705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:53 devstack sudo[108705]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1" returned: 0 in 0.243s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:53 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:29:53 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:53 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4f498d-1a45-4def-bc42-81300402e58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:53 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fcb90c5-3673-4351-8ecd-a19872826a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:29:53 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Volume volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1 (c0a791c4-45a9-408a-82f5-7ddb9d6972f1): created successfully Sep 28 18:29:53 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fcb90c5-3673-4351-8ecd-a19872826a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:29:53 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Flow 'volume_create_manager' (ecf9ca13-9fe5-494a-a4a2-86296dc1c2f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:53 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-2567331d-6981-4aaf-8360-bd1ba2a38aff tempest-ProjectMemberTests-1075311172 None] Created volume successfully. Sep 28 18:29:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3b203e3b-dca1-4add-bb49-d736b6c1c7b5 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3b203e3b-dca1-4add-bb49-d736b6c1c7b5 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:54 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-3b203e3b-dca1-4add-bb49-d736b6c1c7b5 tempest-ProjectMemberTests-1075311172 None] Creating offline snapshot efdd02f1-7a18-432a-a74c-03c12117b6b0 of volume c0a791c4-45a9-408a-82f5-7ddb9d6972f1 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:29:54 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6eee33-2243-423d-9e65-21881a540570]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3b203e3b-dca1-4add-bb49-d736b6c1c7b5 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:54 devstack sudo[108708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1 Sep 28 18:29:54 devstack sudo[108708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:54 devstack sudo[108708]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3b203e3b-dca1-4add-bb49-d736b6c1c7b5 tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1" returned: 0 in 0.396s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3b203e3b-dca1-4add-bb49-d736b6c1c7b5 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1.efdd02f1-7a18-432a-a74c-03c12117b6b0 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:54 devstack sudo[108713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1.efdd02f1-7a18-432a-a74c-03c12117b6b0 1G Sep 28 18:29:54 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:54 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3b203e3b-dca1-4add-bb49-d736b6c1c7b5 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1.efdd02f1-7a18-432a-a74c-03c12117b6b0 1G" returned: 0 in 0.415s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:54 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3b203e3b-dca1-4add-bb49-d736b6c1c7b5 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1.efdd02f1-7a18-432a-a74c-03c12117b6b0 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:54 devstack sudo[108719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1.efdd02f1-7a18-432a-a74c-03c12117b6b0 Sep 28 18:29:54 devstack sudo[108719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:55 devstack sudo[108719]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3b203e3b-dca1-4add-bb49-d736b6c1c7b5 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1.efdd02f1-7a18-432a-a74c-03c12117b6b0" returned: 0 in 0.294s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:55 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-3b203e3b-dca1-4add-bb49-d736b6c1c7b5 tempest-ProjectMemberTests-1075311172 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1.efdd02f1-7a18-432a-a74c-03c12117b6b0 is being set with open permissions: ugo+rw Sep 28 18:29:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3b203e3b-dca1-4add-bb49-d736b6c1c7b5 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1.efdd02f1-7a18-432a-a74c-03c12117b6b0 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:55 devstack sudo[108724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1.efdd02f1-7a18-432a-a74c-03c12117b6b0 Sep 28 18:29:55 devstack sudo[108724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:55 devstack sudo[108724]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3b203e3b-dca1-4add-bb49-d736b6c1c7b5 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1.efdd02f1-7a18-432a-a74c-03c12117b6b0" returned: 0 in 0.254s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3b203e3b-dca1-4add-bb49-d736b6c1c7b5 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:55 devstack sudo[108727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1.info Sep 28 18:29:55 devstack sudo[108727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:55 devstack sudo[108727]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3b203e3b-dca1-4add-bb49-d736b6c1c7b5 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1.info" returned: 0 in 0.263s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:55 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-3b203e3b-dca1-4add-bb49-d736b6c1c7b5 tempest-ProjectMemberTests-1075311172 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1.info is being set with open permissions: ugo+rw Sep 28 18:29:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3b203e3b-dca1-4add-bb49-d736b6c1c7b5 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:55 devstack sudo[108730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1.info Sep 28 18:29:55 devstack sudo[108730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:55 devstack sudo[108730]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:55 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3b203e3b-dca1-4add-bb49-d736b6c1c7b5 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1.info" returned: 0 in 0.276s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3b203e3b-dca1-4add-bb49-d736b6c1c7b5 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.984s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:56 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-3b203e3b-dca1-4add-bb49-d736b6c1c7b5 tempest-ProjectMemberTests-1075311172 None] Create snapshot completed successfully Sep 28 18:29:56 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-87db414e-2458-49f0-8551-01c6f9f74551 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-efdd02f1-7a18-432a-a74c-03c12117b6b0-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:56 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-87db414e-2458-49f0-8551-01c6f9f74551 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-efdd02f1-7a18-432a-a74c-03c12117b6b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:56 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-87db414e-2458-49f0-8551-01c6f9f74551 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-quobyte-c0a791c4-45a9-408a-82f5-7ddb9d6972f1" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:56 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-87db414e-2458-49f0-8551-01c6f9f74551 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-c0a791c4-45a9-408a-82f5-7ddb9d6972f1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:56 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-87db414e-2458-49f0-8551-01c6f9f74551 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-quobyte-efdd02f1-7a18-432a-a74c-03c12117b6b0" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:56 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-87db414e-2458-49f0-8551-01c6f9f74551 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-efdd02f1-7a18-432a-a74c-03c12117b6b0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-87db414e-2458-49f0-8551-01c6f9f74551 tempest-ProjectMemberTests-1075311172 None] Deleting offline snapshot efdd02f1-7a18-432a-a74c-03c12117b6b0 of volume c0a791c4-45a9-408a-82f5-7ddb9d6972f1 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:29:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-87db414e-2458-49f0-8551-01c6f9f74551 tempest-ProjectMemberTests-1075311172 None] snapshot_file for this snap is: volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1.efdd02f1-7a18-432a-a74c-03c12117b6b0 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:29:56 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[c842d8e0-6bb5-4fea-b780-fd0e752b3b12]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-87db414e-2458-49f0-8551-01c6f9f74551 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1.efdd02f1-7a18-432a-a74c-03c12117b6b0 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:56 devstack sudo[108733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1.efdd02f1-7a18-432a-a74c-03c12117b6b0 Sep 28 18:29:56 devstack sudo[108733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:56 devstack sudo[108733]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-87db414e-2458-49f0-8551-01c6f9f74551 tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1.efdd02f1-7a18-432a-a74c-03c12117b6b0" returned: 0 in 0.367s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-87db414e-2458-49f0-8551-01c6f9f74551 tempest-ProjectMemberTests-1075311172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:29:56 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb4d91d-10bd-4943-8503-058ebf04f70a]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-87db414e-2458-49f0-8551-01c6f9f74551 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:56 devstack sudo[108738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1 Sep 28 18:29:56 devstack sudo[108738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:57 devstack sudo[108738]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-87db414e-2458-49f0-8551-01c6f9f74551 tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1" returned: 0 in 0.380s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-87db414e-2458-49f0-8551-01c6f9f74551 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1.efdd02f1-7a18-432a-a74c-03c12117b6b0 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:57 devstack sudo[108743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1.efdd02f1-7a18-432a-a74c-03c12117b6b0 Sep 28 18:29:57 devstack sudo[108743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:57 devstack sudo[108743]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-87db414e-2458-49f0-8551-01c6f9f74551 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1.efdd02f1-7a18-432a-a74c-03c12117b6b0" returned: 0 in 0.362s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-87db414e-2458-49f0-8551-01c6f9f74551 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1.efdd02f1-7a18-432a-a74c-03c12117b6b0 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:57 devstack sudo[108748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1.efdd02f1-7a18-432a-a74c-03c12117b6b0 Sep 28 18:29:57 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:57 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-87db414e-2458-49f0-8551-01c6f9f74551 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1.efdd02f1-7a18-432a-a74c-03c12117b6b0" returned: 0 in 0.261s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:57 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-87db414e-2458-49f0-8551-01c6f9f74551 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-efdd02f1-7a18-432a-a74c-03c12117b6b0" released by "_delete_snapshot" :: held 1.469s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:57 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-87db414e-2458-49f0-8551-01c6f9f74551 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-c0a791c4-45a9-408a-82f5-7ddb9d6972f1" released by "delete_snapshot" :: held 1.493s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:57 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-87db414e-2458-49f0-8551-01c6f9f74551 tempest-ProjectMemberTests-1075311172 None] Created reservations ['e49571ab-72b0-4109-a9ce-bd9ddf81aed0', 'b03f5a14-d616-4c1e-a317-1d4dc6ec86a5', '88d27923-92a1-4a7f-83b5-9e5aa7f5f468', 'e6bddf9e-6450-41c5-b96d-7dbe06076229'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:57 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-87db414e-2458-49f0-8551-01c6f9f74551 tempest-ProjectMemberTests-1075311172 None] Delete snapshot completed successfully. Sep 28 18:29:57 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-87db414e-2458-49f0-8551-01c6f9f74551 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-efdd02f1-7a18-432a-a74c-03c12117b6b0-delete_snapshot" released by "delete_snapshot" :: held 1.637s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:58 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-12250eed-ea01-4ad7-9468-165d5f7817a8 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-c0a791c4-45a9-408a-82f5-7ddb9d6972f1-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:58 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-12250eed-ea01-4ad7-9468-165d5f7817a8 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-c0a791c4-45a9-408a-82f5-7ddb9d6972f1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:58 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-12250eed-ea01-4ad7-9468-165d5f7817a8 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-quobyte-c0a791c4-45a9-408a-82f5-7ddb9d6972f1" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:29:58 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-12250eed-ea01-4ad7-9468-165d5f7817a8 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-c0a791c4-45a9-408a-82f5-7ddb9d6972f1" acquired by "delete_volume" :: waited 0.016s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:29:58 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fb7c53-0b46-42b1-b4fb-63bed9de59ad]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:29:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-12250eed-ea01-4ad7-9468-165d5f7817a8 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:58 devstack sudo[108751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1 Sep 28 18:29:58 devstack sudo[108751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:58 devstack sudo[108751]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-12250eed-ea01-4ad7-9468-165d5f7817a8 tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1" returned: 0 in 0.363s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-12250eed-ea01-4ad7-9468-165d5f7817a8 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:58 devstack sudo[108756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1 Sep 28 18:29:58 devstack sudo[108756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:59 devstack sudo[108756]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-12250eed-ea01-4ad7-9468-165d5f7817a8 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-c0a791c4-45a9-408a-82f5-7ddb9d6972f1" returned: 0 in 0.253s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-12250eed-ea01-4ad7-9468-165d5f7817a8 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-c0a791c4-45a9-408a-82f5-7ddb9d6972f1" released by "delete_volume" :: held 0.675s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:59 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-12250eed-ea01-4ad7-9468-165d5f7817a8 tempest-ProjectMemberTests-1075311172 None] Created reservations ['2f19d39e-328b-44bf-b252-4f5ab100fc5b', 'a9db27e5-7af6-4495-9f34-7909596a78bc', '3701c926-713a-48c4-83a4-39fa3882bc93', '079fc4c3-1693-4c25-a628-465ecc38f3cc'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:29:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-12250eed-ea01-4ad7-9468-165d5f7817a8 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:29:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-12250eed-ea01-4ad7-9468-165d5f7817a8 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:29:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-12250eed-ea01-4ad7-9468-165d5f7817a8 tempest-ProjectMemberTests-1075311172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:29:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-12250eed-ea01-4ad7-9468-165d5f7817a8 tempest-ProjectMemberTests-1075311172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:29:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-12250eed-ea01-4ad7-9468-165d5f7817a8 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:29:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-12250eed-ea01-4ad7-9468-165d5f7817a8 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:29:59 devstack sudo[108759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:29:59 devstack sudo[108759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:29:59 devstack sudo[108759]: pam_unix(sudo:session): session closed for user root Sep 28 18:29:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-12250eed-ea01-4ad7-9468-165d5f7817a8 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.256s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:29:59 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-12250eed-ea01-4ad7-9468-165d5f7817a8 tempest-ProjectMemberTests-1075311172 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:29:59 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-12250eed-ea01-4ad7-9468-165d5f7817a8 tempest-ProjectMemberTests-1075311172 None] Deleted volume successfully. Sep 28 18:29:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-12250eed-ea01-4ad7-9468-165d5f7817a8 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-c0a791c4-45a9-408a-82f5-7ddb9d6972f1-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:29:59 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:29:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Flow 'volume_create_manager' (4ee8c591-b90c-4846-98ee-58762c2471dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:29:59 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7934f196-4b6a-40e1-98a8-d19864a8e306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7934f196-4b6a-40e1-98a8-d19864a8e306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-890264020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c908706-638e-4d25-8b20-5a19d16ce122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9e99502d25421799dbe9850a9f19de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:00Z,use_quota=True,user_id='e2b01c6a248345f2a380ffc12b39bfb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4adff1c3-a1e2-4e90-b0af-758aeda9f7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4adff1c3-a1e2-4e90-b0af-758aeda9f7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3b69d7-3f50-4ec7-bb9d-a3f1505d7555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3b69d7-3f50-4ec7-bb9d-a3f1505d7555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c908706-638e-4d25-8b20-5a19d16ce122', 'volume_name': 'volume-1c908706-638e-4d25-8b20-5a19d16ce122', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5905cb1d-2096-48fc-bd7c-36c5885c5e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5905cb1d-2096-48fc-bd7c-36c5885c5e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6121b9b3-29a2-4e6f-ad53-f8d536de43cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:00 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Volume 1c908706-638e-4d25-8b20-5a19d16ce122: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c908706-638e-4d25-8b20-5a19d16ce122', 'volume_size': 1} Sep 28 18:30:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-890264020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c908706-638e-4d25-8b20-5a19d16ce122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9e99502d25421799dbe9850a9f19de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:00Z,use_quota=True,user_id='e2b01c6a248345f2a380ffc12b39bfb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:30:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Creating volume 1c908706-638e-4d25-8b20-5a19d16ce122 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:30:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:00 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:30:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:00 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122 1073741824 Sep 28 18:30:00 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:00 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122 1073741824" returned: 0 in 0.473s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:00 devstack sudo[108768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122 Sep 28 18:30:00 devstack sudo[108768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:00 devstack sudo[108768]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122" returned: 0 in 0.265s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:00 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:30:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6121b9b3-29a2-4e6f-ad53-f8d536de43cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c908706-638e-4d25-8b20-5a19d16ce122', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (651ec146-d40d-4b47-ae12-909f63cdfc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:00 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Volume volume-1c908706-638e-4d25-8b20-5a19d16ce122 (1c908706-638e-4d25-8b20-5a19d16ce122): created successfully Sep 28 18:30:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (651ec146-d40d-4b47-ae12-909f63cdfc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:00 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Flow 'volume_create_manager' (4ee8c591-b90c-4846-98ee-58762c2471dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:00 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-cb39bb62-0971-4534-b0f3-424130484f4b tempest-ProjectMemberTests-1075311172 None] Created volume successfully. Sep 28 18:30:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-101ed669-2bce-4baf-a292-db7384d5d8b3 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-101ed669-2bce-4baf-a292-db7384d5d8b3 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-101ed669-2bce-4baf-a292-db7384d5d8b3 tempest-ProjectMemberTests-1075311172 None] Creating offline snapshot 1b0ec118-61ab-41f6-bae5-3d14e3df6a37 of volume 1c908706-638e-4d25-8b20-5a19d16ce122 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:30:02 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f63824-a8b9-49d0-8e8a-46038e9c8921]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-101ed669-2bce-4baf-a292-db7384d5d8b3 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:02 devstack sudo[108778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122 Sep 28 18:30:02 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:02 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-101ed669-2bce-4baf-a292-db7384d5d8b3 tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122" returned: 0 in 0.430s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-101ed669-2bce-4baf-a292-db7384d5d8b3 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122.1b0ec118-61ab-41f6-bae5-3d14e3df6a37 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:02 devstack sudo[108783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122.1b0ec118-61ab-41f6-bae5-3d14e3df6a37 1G Sep 28 18:30:02 devstack sudo[108783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:03 devstack sudo[108783]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-101ed669-2bce-4baf-a292-db7384d5d8b3 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122.1b0ec118-61ab-41f6-bae5-3d14e3df6a37 1G" returned: 0 in 0.441s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-101ed669-2bce-4baf-a292-db7384d5d8b3 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c908706-638e-4d25-8b20-5a19d16ce122 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122.1b0ec118-61ab-41f6-bae5-3d14e3df6a37 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:03 devstack sudo[108789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c908706-638e-4d25-8b20-5a19d16ce122 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122.1b0ec118-61ab-41f6-bae5-3d14e3df6a37 Sep 28 18:30:03 devstack sudo[108789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:03 devstack sudo[108789]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-101ed669-2bce-4baf-a292-db7384d5d8b3 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c908706-638e-4d25-8b20-5a19d16ce122 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122.1b0ec118-61ab-41f6-bae5-3d14e3df6a37" returned: 0 in 0.309s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:03 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-101ed669-2bce-4baf-a292-db7384d5d8b3 tempest-ProjectMemberTests-1075311172 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122.1b0ec118-61ab-41f6-bae5-3d14e3df6a37 is being set with open permissions: ugo+rw Sep 28 18:30:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-101ed669-2bce-4baf-a292-db7384d5d8b3 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122.1b0ec118-61ab-41f6-bae5-3d14e3df6a37 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:03 devstack sudo[108794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122.1b0ec118-61ab-41f6-bae5-3d14e3df6a37 Sep 28 18:30:03 devstack sudo[108794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:03 devstack sudo[108794]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-101ed669-2bce-4baf-a292-db7384d5d8b3 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122.1b0ec118-61ab-41f6-bae5-3d14e3df6a37" returned: 0 in 0.259s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-101ed669-2bce-4baf-a292-db7384d5d8b3 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:03 devstack sudo[108797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122.info Sep 28 18:30:03 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:04 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-101ed669-2bce-4baf-a292-db7384d5d8b3 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122.info" returned: 0 in 0.264s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:04 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-101ed669-2bce-4baf-a292-db7384d5d8b3 tempest-ProjectMemberTests-1075311172 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122.info is being set with open permissions: ugo+rw Sep 28 18:30:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-101ed669-2bce-4baf-a292-db7384d5d8b3 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:04 devstack sudo[108800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122.info Sep 28 18:30:04 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:04 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-101ed669-2bce-4baf-a292-db7384d5d8b3 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122.info" returned: 0 in 0.268s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-101ed669-2bce-4baf-a292-db7384d5d8b3 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.062s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:04 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-101ed669-2bce-4baf-a292-db7384d5d8b3 tempest-ProjectMemberTests-1075311172 None] Create snapshot completed successfully Sep 28 18:30:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:30:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:04 devstack sudo[108839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:30:04 devstack sudo[108839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:04 devstack sudo[108839]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.277s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:04 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager._thread_info {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:30:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread count: 28 {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:30:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread info: [<_MainThread(MainThread, started 129097393381504)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:30:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-add51963-195c-4055-ad72-97b90b1b73eb tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-1b0ec118-61ab-41f6-bae5-3d14e3df6a37-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-add51963-195c-4055-ad72-97b90b1b73eb tempest-ProjectMemberTests-1075311172 None] Lock "cinder-1b0ec118-61ab-41f6-bae5-3d14e3df6a37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-add51963-195c-4055-ad72-97b90b1b73eb tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-quobyte-1c908706-638e-4d25-8b20-5a19d16ce122" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-add51963-195c-4055-ad72-97b90b1b73eb tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-1c908706-638e-4d25-8b20-5a19d16ce122" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-add51963-195c-4055-ad72-97b90b1b73eb tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-quobyte-1b0ec118-61ab-41f6-bae5-3d14e3df6a37" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:05 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-add51963-195c-4055-ad72-97b90b1b73eb tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-1b0ec118-61ab-41f6-bae5-3d14e3df6a37" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-add51963-195c-4055-ad72-97b90b1b73eb tempest-ProjectMemberTests-1075311172 None] Deleting offline snapshot 1b0ec118-61ab-41f6-bae5-3d14e3df6a37 of volume 1c908706-638e-4d25-8b20-5a19d16ce122 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:30:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-add51963-195c-4055-ad72-97b90b1b73eb tempest-ProjectMemberTests-1075311172 None] snapshot_file for this snap is: volume-1c908706-638e-4d25-8b20-5a19d16ce122.1b0ec118-61ab-41f6-bae5-3d14e3df6a37 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:30:05 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c62977-c8d7-406c-8aad-881ede5c712b]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-add51963-195c-4055-ad72-97b90b1b73eb tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122.1b0ec118-61ab-41f6-bae5-3d14e3df6a37 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:05 devstack sudo[108846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122.1b0ec118-61ab-41f6-bae5-3d14e3df6a37 Sep 28 18:30:05 devstack sudo[108846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:05 devstack sudo[108846]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-add51963-195c-4055-ad72-97b90b1b73eb tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122.1b0ec118-61ab-41f6-bae5-3d14e3df6a37" returned: 0 in 0.373s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-add51963-195c-4055-ad72-97b90b1b73eb tempest-ProjectMemberTests-1075311172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c908706-638e-4d25-8b20-5a19d16ce122(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:30:05 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[acada64a-52d2-43df-804f-851bb5cd518a]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-add51963-195c-4055-ad72-97b90b1b73eb tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:06 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122 Sep 28 18:30:06 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:06 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-add51963-195c-4055-ad72-97b90b1b73eb tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122" returned: 0 in 0.354s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-add51963-195c-4055-ad72-97b90b1b73eb tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122.1b0ec118-61ab-41f6-bae5-3d14e3df6a37 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:06 devstack sudo[108856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122.1b0ec118-61ab-41f6-bae5-3d14e3df6a37 Sep 28 18:30:06 devstack sudo[108856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:06 devstack sudo[108856]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-add51963-195c-4055-ad72-97b90b1b73eb tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122.1b0ec118-61ab-41f6-bae5-3d14e3df6a37" returned: 0 in 0.337s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-add51963-195c-4055-ad72-97b90b1b73eb tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122.1b0ec118-61ab-41f6-bae5-3d14e3df6a37 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:06 devstack sudo[108861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122.1b0ec118-61ab-41f6-bae5-3d14e3df6a37 Sep 28 18:30:06 devstack sudo[108861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:06 devstack sudo[108861]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-add51963-195c-4055-ad72-97b90b1b73eb tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122.1b0ec118-61ab-41f6-bae5-3d14e3df6a37" returned: 0 in 0.268s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-add51963-195c-4055-ad72-97b90b1b73eb tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-1b0ec118-61ab-41f6-bae5-3d14e3df6a37" released by "_delete_snapshot" :: held 1.436s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:06 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-add51963-195c-4055-ad72-97b90b1b73eb tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-1c908706-638e-4d25-8b20-5a19d16ce122" released by "delete_snapshot" :: held 1.458s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:07 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-add51963-195c-4055-ad72-97b90b1b73eb tempest-ProjectMemberTests-1075311172 None] Created reservations ['15149026-37eb-4b3d-a79c-9354ef5235d2', '397bafa8-29da-4ebd-bf16-ddac10fb3600', '86d759d0-c40e-4186-8785-29c4417129cc', '12674bd3-6c0f-4254-8f62-83c0e224fd33'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:07 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-add51963-195c-4055-ad72-97b90b1b73eb tempest-ProjectMemberTests-1075311172 None] Delete snapshot completed successfully. Sep 28 18:30:07 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-add51963-195c-4055-ad72-97b90b1b73eb tempest-ProjectMemberTests-1075311172 None] Lock "cinder-1b0ec118-61ab-41f6-bae5-3d14e3df6a37-delete_snapshot" released by "delete_snapshot" :: held 1.614s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:07 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3e9e57d8-7c5e-4066-860c-2fa0e8e71a33 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-1c908706-638e-4d25-8b20-5a19d16ce122-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:07 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3e9e57d8-7c5e-4066-860c-2fa0e8e71a33 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-1c908706-638e-4d25-8b20-5a19d16ce122-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:07 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3e9e57d8-7c5e-4066-860c-2fa0e8e71a33 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-quobyte-1c908706-638e-4d25-8b20-5a19d16ce122" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:07 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3e9e57d8-7c5e-4066-860c-2fa0e8e71a33 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-1c908706-638e-4d25-8b20-5a19d16ce122" acquired by "delete_volume" :: waited 0.016s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:07 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad793bc-9a54-4ef9-8712-e7b116f5b08e]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3e9e57d8-7c5e-4066-860c-2fa0e8e71a33 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:07 devstack sudo[108864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122 Sep 28 18:30:07 devstack sudo[108864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:08 devstack sudo[108864]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3e9e57d8-7c5e-4066-860c-2fa0e8e71a33 tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122" returned: 0 in 0.391s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3e9e57d8-7c5e-4066-860c-2fa0e8e71a33 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:08 devstack sudo[108869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122 Sep 28 18:30:08 devstack sudo[108869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:08 devstack sudo[108869]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3e9e57d8-7c5e-4066-860c-2fa0e8e71a33 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-1c908706-638e-4d25-8b20-5a19d16ce122" returned: 0 in 0.282s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:08 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3e9e57d8-7c5e-4066-860c-2fa0e8e71a33 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-1c908706-638e-4d25-8b20-5a19d16ce122" released by "delete_volume" :: held 0.746s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:08 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-3e9e57d8-7c5e-4066-860c-2fa0e8e71a33 tempest-ProjectMemberTests-1075311172 None] Created reservations ['698b0c05-94e7-4c93-a8b5-ff3bf8b79641', '219a2aee-d430-4cf1-a4bd-00a2adfbed51', 'd6839139-0512-4960-9ae6-f5ea3804f215', 'ddbbed70-37aa-4f40-9580-6fbc3bba8b60'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3e9e57d8-7c5e-4066-860c-2fa0e8e71a33 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3e9e57d8-7c5e-4066-860c-2fa0e8e71a33 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:08 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3e9e57d8-7c5e-4066-860c-2fa0e8e71a33 tempest-ProjectMemberTests-1075311172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:08 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3e9e57d8-7c5e-4066-860c-2fa0e8e71a33 tempest-ProjectMemberTests-1075311172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3e9e57d8-7c5e-4066-860c-2fa0e8e71a33 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3e9e57d8-7c5e-4066-860c-2fa0e8e71a33 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:08 devstack sudo[108872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:30:08 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:08 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3e9e57d8-7c5e-4066-860c-2fa0e8e71a33 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.306s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:08 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-3e9e57d8-7c5e-4066-860c-2fa0e8e71a33 tempest-ProjectMemberTests-1075311172 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:08 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-3e9e57d8-7c5e-4066-860c-2fa0e8e71a33 tempest-ProjectMemberTests-1075311172 None] Deleted volume successfully. Sep 28 18:30:08 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-3e9e57d8-7c5e-4066-860c-2fa0e8e71a33 tempest-ProjectMemberTests-1075311172 None] Lock "cinder-1c908706-638e-4d25-8b20-5a19d16ce122-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:09 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Flow 'volume_create_manager' (56634e4b-b1e2-4dbb-88ee-589bdbe2f822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c63a019b-951d-40f5-bbf4-9a4211f13548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c63a019b-951d-40f5-bbf4-9a4211f13548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1847963214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7994c2f0-167a-4df1-a69e-dae0fba3b966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9e99502d25421799dbe9850a9f19de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:09Z,use_quota=True,user_id='e2b01c6a248345f2a380ffc12b39bfb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b9077c8-6642-4a8f-ac85-a05239571e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b9077c8-6642-4a8f-ac85-a05239571e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d296e55-2623-4cea-8853-6aa950778dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d296e55-2623-4cea-8853-6aa950778dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7994c2f0-167a-4df1-a69e-dae0fba3b966', 'volume_name': 'volume-7994c2f0-167a-4df1-a69e-dae0fba3b966', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab34886-0c54-4493-9a82-504653789755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab34886-0c54-4493-9a82-504653789755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:09 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81aab10f-07c9-4063-bbfb-dd11923732cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:09 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Volume 7994c2f0-167a-4df1-a69e-dae0fba3b966: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7994c2f0-167a-4df1-a69e-dae0fba3b966', 'volume_size': 1} Sep 28 18:30:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1847963214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7994c2f0-167a-4df1-a69e-dae0fba3b966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b9e99502d25421799dbe9850a9f19de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:09Z,use_quota=True,user_id='e2b01c6a248345f2a380ffc12b39bfb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:30:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Creating volume 7994c2f0-167a-4df1-a69e-dae0fba3b966 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:30:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:09 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:30:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:09 devstack sudo[108875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966 1073741824 Sep 28 18:30:09 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:09 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966 1073741824" returned: 0 in 0.474s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:09 devstack sudo[108880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966 Sep 28 18:30:09 devstack sudo[108880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:10 devstack sudo[108880]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966" returned: 0 in 0.267s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:10 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:30:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:10 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81aab10f-07c9-4063-bbfb-dd11923732cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7994c2f0-167a-4df1-a69e-dae0fba3b966', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:10 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ddaa50-3aff-4537-8648-c87e1663d4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:10 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Volume volume-7994c2f0-167a-4df1-a69e-dae0fba3b966 (7994c2f0-167a-4df1-a69e-dae0fba3b966): created successfully Sep 28 18:30:10 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ddaa50-3aff-4537-8648-c87e1663d4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:10 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Flow 'volume_create_manager' (56634e4b-b1e2-4dbb-88ee-589bdbe2f822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:10 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-52b60a65-dc3e-41ca-a06d-3068d3ca58b9 tempest-ProjectMemberTests-1075311172 None] Created volume successfully. Sep 28 18:30:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-dee3a571-22a4-41d4-a269-83c08406a150 tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-dee3a571-22a4-41d4-a269-83c08406a150 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:11 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-dee3a571-22a4-41d4-a269-83c08406a150 tempest-ProjectMemberTests-1075311172 None] Creating offline snapshot dfa40755-b046-4a29-8469-232d7bd524d0 of volume 7994c2f0-167a-4df1-a69e-dae0fba3b966 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:30:11 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b21d13d-edfa-4cee-aba2-5d4243b038c6]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-dee3a571-22a4-41d4-a269-83c08406a150 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:11 devstack sudo[108883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966 Sep 28 18:30:11 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:12 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-dee3a571-22a4-41d4-a269-83c08406a150 tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966" returned: 0 in 0.399s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-dee3a571-22a4-41d4-a269-83c08406a150 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966.dfa40755-b046-4a29-8469-232d7bd524d0 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:12 devstack sudo[108889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966.dfa40755-b046-4a29-8469-232d7bd524d0 1G Sep 28 18:30:12 devstack sudo[108889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:12 devstack sudo[108889]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-dee3a571-22a4-41d4-a269-83c08406a150 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966.dfa40755-b046-4a29-8469-232d7bd524d0 1G" returned: 0 in 0.435s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-dee3a571-22a4-41d4-a269-83c08406a150 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7994c2f0-167a-4df1-a69e-dae0fba3b966 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966.dfa40755-b046-4a29-8469-232d7bd524d0 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:12 devstack sudo[108895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7994c2f0-167a-4df1-a69e-dae0fba3b966 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966.dfa40755-b046-4a29-8469-232d7bd524d0 Sep 28 18:30:12 devstack sudo[108895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:12 devstack sudo[108895]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-dee3a571-22a4-41d4-a269-83c08406a150 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7994c2f0-167a-4df1-a69e-dae0fba3b966 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966.dfa40755-b046-4a29-8469-232d7bd524d0" returned: 0 in 0.314s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:12 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-dee3a571-22a4-41d4-a269-83c08406a150 tempest-ProjectMemberTests-1075311172 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966.dfa40755-b046-4a29-8469-232d7bd524d0 is being set with open permissions: ugo+rw Sep 28 18:30:12 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-dee3a571-22a4-41d4-a269-83c08406a150 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966.dfa40755-b046-4a29-8469-232d7bd524d0 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:12 devstack sudo[108900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966.dfa40755-b046-4a29-8469-232d7bd524d0 Sep 28 18:30:12 devstack sudo[108900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:13 devstack sudo[108900]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-dee3a571-22a4-41d4-a269-83c08406a150 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966.dfa40755-b046-4a29-8469-232d7bd524d0" returned: 0 in 0.266s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-dee3a571-22a4-41d4-a269-83c08406a150 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:13 devstack sudo[108903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966.info Sep 28 18:30:13 devstack sudo[108903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:13 devstack sudo[108903]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-dee3a571-22a4-41d4-a269-83c08406a150 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966.info" returned: 0 in 0.278s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:13 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-dee3a571-22a4-41d4-a269-83c08406a150 tempest-ProjectMemberTests-1075311172 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966.info is being set with open permissions: ugo+rw Sep 28 18:30:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-dee3a571-22a4-41d4-a269-83c08406a150 tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:13 devstack sudo[108906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966.info Sep 28 18:30:13 devstack sudo[108906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:13 devstack sudo[108906]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-dee3a571-22a4-41d4-a269-83c08406a150 tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966.info" returned: 0 in 0.272s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:13 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-dee3a571-22a4-41d4-a269-83c08406a150 tempest-ProjectMemberTests-1075311172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.055s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:13 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-dee3a571-22a4-41d4-a269-83c08406a150 tempest-ProjectMemberTests-1075311172 None] Create snapshot completed successfully Sep 28 18:30:14 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b6f4e6f6-3ca2-4783-a905-7145b595472b tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-dfa40755-b046-4a29-8469-232d7bd524d0-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:14 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b6f4e6f6-3ca2-4783-a905-7145b595472b tempest-ProjectMemberTests-1075311172 None] Lock "cinder-dfa40755-b046-4a29-8469-232d7bd524d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:14 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b6f4e6f6-3ca2-4783-a905-7145b595472b tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-quobyte-7994c2f0-167a-4df1-a69e-dae0fba3b966" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:14 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b6f4e6f6-3ca2-4783-a905-7145b595472b tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-7994c2f0-167a-4df1-a69e-dae0fba3b966" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:14 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b6f4e6f6-3ca2-4783-a905-7145b595472b tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-quobyte-dfa40755-b046-4a29-8469-232d7bd524d0" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:14 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b6f4e6f6-3ca2-4783-a905-7145b595472b tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-dfa40755-b046-4a29-8469-232d7bd524d0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:14 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-b6f4e6f6-3ca2-4783-a905-7145b595472b tempest-ProjectMemberTests-1075311172 None] Deleting offline snapshot dfa40755-b046-4a29-8469-232d7bd524d0 of volume 7994c2f0-167a-4df1-a69e-dae0fba3b966 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:30:14 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-b6f4e6f6-3ca2-4783-a905-7145b595472b tempest-ProjectMemberTests-1075311172 None] snapshot_file for this snap is: volume-7994c2f0-167a-4df1-a69e-dae0fba3b966.dfa40755-b046-4a29-8469-232d7bd524d0 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:30:14 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[485f5baf-c15c-437e-bb76-4130ea064ce9]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:14 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b6f4e6f6-3ca2-4783-a905-7145b595472b tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966.dfa40755-b046-4a29-8469-232d7bd524d0 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:15 devstack sudo[108909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966.dfa40755-b046-4a29-8469-232d7bd524d0 Sep 28 18:30:15 devstack sudo[108909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:15 devstack sudo[108909]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b6f4e6f6-3ca2-4783-a905-7145b595472b tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966.dfa40755-b046-4a29-8469-232d7bd524d0" returned: 0 in 0.349s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:15 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-b6f4e6f6-3ca2-4783-a905-7145b595472b tempest-ProjectMemberTests-1075311172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7994c2f0-167a-4df1-a69e-dae0fba3b966(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:30:15 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb818498-66b7-4bb7-9821-774f6a9135bd]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b6f4e6f6-3ca2-4783-a905-7145b595472b tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:15 devstack sudo[108914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966 Sep 28 18:30:15 devstack sudo[108914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:15 devstack sudo[108914]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b6f4e6f6-3ca2-4783-a905-7145b595472b tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966" returned: 0 in 0.372s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:15 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b6f4e6f6-3ca2-4783-a905-7145b595472b tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966.dfa40755-b046-4a29-8469-232d7bd524d0 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:15 devstack sudo[108919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966.dfa40755-b046-4a29-8469-232d7bd524d0 Sep 28 18:30:15 devstack sudo[108919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:16 devstack sudo[108919]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b6f4e6f6-3ca2-4783-a905-7145b595472b tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966.dfa40755-b046-4a29-8469-232d7bd524d0" returned: 0 in 0.339s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b6f4e6f6-3ca2-4783-a905-7145b595472b tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966.dfa40755-b046-4a29-8469-232d7bd524d0 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:16 devstack sudo[108924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966.dfa40755-b046-4a29-8469-232d7bd524d0 Sep 28 18:30:16 devstack sudo[108924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:16 devstack sudo[108924]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:16 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b6f4e6f6-3ca2-4783-a905-7145b595472b tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966.dfa40755-b046-4a29-8469-232d7bd524d0" returned: 0 in 0.253s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:16 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b6f4e6f6-3ca2-4783-a905-7145b595472b tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-dfa40755-b046-4a29-8469-232d7bd524d0" released by "_delete_snapshot" :: held 1.420s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:16 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b6f4e6f6-3ca2-4783-a905-7145b595472b tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-7994c2f0-167a-4df1-a69e-dae0fba3b966" released by "delete_snapshot" :: held 1.446s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:16 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-b6f4e6f6-3ca2-4783-a905-7145b595472b tempest-ProjectMemberTests-1075311172 None] Created reservations ['6918e2fd-6963-435c-8758-823d537a8cff', '058b0385-c757-4fd1-a3a2-b9745ad6ed46', 'cb4ce542-8e41-479d-96d8-9cebf50a6820', '89a89723-14f6-4b20-b12c-c9d3a855822b'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:16 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-b6f4e6f6-3ca2-4783-a905-7145b595472b tempest-ProjectMemberTests-1075311172 None] Delete snapshot completed successfully. Sep 28 18:30:16 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b6f4e6f6-3ca2-4783-a905-7145b595472b tempest-ProjectMemberTests-1075311172 None] Lock "cinder-dfa40755-b046-4a29-8469-232d7bd524d0-delete_snapshot" released by "delete_snapshot" :: held 1.598s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:17 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-afbb41e4-99b5-44d0-81a2-1b1f5db227ba tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-7994c2f0-167a-4df1-a69e-dae0fba3b966-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:17 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-afbb41e4-99b5-44d0-81a2-1b1f5db227ba tempest-ProjectMemberTests-1075311172 None] Lock "cinder-7994c2f0-167a-4df1-a69e-dae0fba3b966-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:17 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-afbb41e4-99b5-44d0-81a2-1b1f5db227ba tempest-ProjectMemberTests-1075311172 None] Acquiring lock "cinder-quobyte-7994c2f0-167a-4df1-a69e-dae0fba3b966" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:17 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-afbb41e4-99b5-44d0-81a2-1b1f5db227ba tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-7994c2f0-167a-4df1-a69e-dae0fba3b966" acquired by "delete_volume" :: waited 0.015s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:17 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a79611-c79c-4666-bc63-8bb698049941]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-afbb41e4-99b5-44d0-81a2-1b1f5db227ba tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:17 devstack sudo[108927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966 Sep 28 18:30:17 devstack sudo[108927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:17 devstack sudo[108927]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-afbb41e4-99b5-44d0-81a2-1b1f5db227ba tempest-ProjectMemberTests-1075311172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966" returned: 0 in 0.398s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-afbb41e4-99b5-44d0-81a2-1b1f5db227ba tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:17 devstack sudo[108933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966 Sep 28 18:30:17 devstack sudo[108933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:17 devstack sudo[108933]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-afbb41e4-99b5-44d0-81a2-1b1f5db227ba tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-7994c2f0-167a-4df1-a69e-dae0fba3b966" returned: 0 in 0.288s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:17 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-afbb41e4-99b5-44d0-81a2-1b1f5db227ba tempest-ProjectMemberTests-1075311172 None] Lock "cinder-quobyte-7994c2f0-167a-4df1-a69e-dae0fba3b966" released by "delete_volume" :: held 0.755s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:17 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-afbb41e4-99b5-44d0-81a2-1b1f5db227ba tempest-ProjectMemberTests-1075311172 None] Created reservations ['b7dd1dfd-ff89-41c3-a035-ff741eca4af4', '3033902a-b41e-4c74-890a-8c4436a4d083', 'e40093d7-11e0-421d-8b14-dbf61ce3cc5f', '8ad630f8-8670-4683-b4f0-a389bb73dd30'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-afbb41e4-99b5-44d0-81a2-1b1f5db227ba tempest-ProjectMemberTests-1075311172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-afbb41e4-99b5-44d0-81a2-1b1f5db227ba tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:17 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-afbb41e4-99b5-44d0-81a2-1b1f5db227ba tempest-ProjectMemberTests-1075311172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:17 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-afbb41e4-99b5-44d0-81a2-1b1f5db227ba tempest-ProjectMemberTests-1075311172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-afbb41e4-99b5-44d0-81a2-1b1f5db227ba tempest-ProjectMemberTests-1075311172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:17 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-afbb41e4-99b5-44d0-81a2-1b1f5db227ba tempest-ProjectMemberTests-1075311172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:17 devstack sudo[108936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:30:17 devstack sudo[108936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:18 devstack sudo[108936]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:18 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-afbb41e4-99b5-44d0-81a2-1b1f5db227ba tempest-ProjectMemberTests-1075311172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.302s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:18 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-afbb41e4-99b5-44d0-81a2-1b1f5db227ba tempest-ProjectMemberTests-1075311172 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:18 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-afbb41e4-99b5-44d0-81a2-1b1f5db227ba tempest-ProjectMemberTests-1075311172 None] Deleted volume successfully. Sep 28 18:30:18 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-afbb41e4-99b5-44d0-81a2-1b1f5db227ba tempest-ProjectMemberTests-1075311172 None] Lock "cinder-7994c2f0-167a-4df1-a69e-dae0fba3b966-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:22 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:UPDATE=125,cinder:SELECT=93,cinder:INSERT=38,cinder:DELETE=10 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:30:22 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=98,cinder:DELETE=10,cinder:INSERT=31,cinder:UPDATE=122 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:30:22 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Flow 'volume_create_manager' (ae54556c-5c79-4878-8730-4039c5d0c83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ebf36a-c152-408d-8289-cb572a7afabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ebf36a-c152-408d-8289-cb572a7afabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1423561789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92db51bb-14a4-44a5-92a9-fb8e44ba4e85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47dda4210e6c4fe683163b4f44ea31a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:23Z,use_quota=True,user_id='c99d41dc85e54f25a934b4454714bd2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee009c51-11c4-4579-ab36-159f5ec1cc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee009c51-11c4-4579-ab36-159f5ec1cc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dc46125-7964-47d1-a2ed-42dbfcd1f834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dc46125-7964-47d1-a2ed-42dbfcd1f834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92db51bb-14a4-44a5-92a9-fb8e44ba4e85', 'volume_name': 'volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fadd8f7-d581-4fc1-850f-766be45c0e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fadd8f7-d581-4fc1-850f-766be45c0e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d2af134-938f-4f22-b806-8f8f43b4022f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:22 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Volume 92db51bb-14a4-44a5-92a9-fb8e44ba4e85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85', 'volume_size': 1} Sep 28 18:30:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:22 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1423561789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92db51bb-14a4-44a5-92a9-fb8e44ba4e85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47dda4210e6c4fe683163b4f44ea31a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:23Z,use_quota=True,user_id='c99d41dc85e54f25a934b4454714bd2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:30:22 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Creating volume 92db51bb-14a4-44a5-92a9-fb8e44ba4e85 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:30:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:22 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:22 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:22 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:22 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:30:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:22 devstack sudo[108941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85 1073741824 Sep 28 18:30:22 devstack sudo[108941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:23 devstack sudo[108941]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85 1073741824" returned: 0 in 0.411s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:23 devstack sudo[108947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85 Sep 28 18:30:23 devstack sudo[108947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:23 devstack sudo[108947]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85" returned: 0 in 0.277s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:30:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d2af134-938f-4f22-b806-8f8f43b4022f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ffb795-9c37-453a-88bf-6ad14fb353f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:23 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Volume volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85 (92db51bb-14a4-44a5-92a9-fb8e44ba4e85): created successfully Sep 28 18:30:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ffb795-9c37-453a-88bf-6ad14fb353f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:23 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Flow 'volume_create_manager' (ae54556c-5c79-4878-8730-4039c5d0c83a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:23 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-574f8fcc-7cef-4086-be2a-52319e4b7359 tempest-ProjectReaderTests-1876210163 None] Created volume successfully. Sep 28 18:30:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e709aff8-b538-46cd-9aff-09bdb0efd168 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e709aff8-b538-46cd-9aff-09bdb0efd168 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:23 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-e709aff8-b538-46cd-9aff-09bdb0efd168 tempest-ProjectReaderTests-1876210163 None] Creating offline snapshot 4cc8f343-bfa8-4484-afd5-5e69b6cb89e1 of volume 92db51bb-14a4-44a5-92a9-fb8e44ba4e85 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:30:23 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8ada05-c4cc-4992-bab3-4f05c501cd61]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e709aff8-b538-46cd-9aff-09bdb0efd168 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:24 devstack sudo[108950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85 Sep 28 18:30:24 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:24 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e709aff8-b538-46cd-9aff-09bdb0efd168 tempest-ProjectReaderTests-1876210163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85" returned: 0 in 0.361s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e709aff8-b538-46cd-9aff-09bdb0efd168 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85.4cc8f343-bfa8-4484-afd5-5e69b6cb89e1 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:24 devstack sudo[108956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85.4cc8f343-bfa8-4484-afd5-5e69b6cb89e1 1G Sep 28 18:30:24 devstack sudo[108956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:24 devstack sudo[108956]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e709aff8-b538-46cd-9aff-09bdb0efd168 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85.4cc8f343-bfa8-4484-afd5-5e69b6cb89e1 1G" returned: 0 in 0.447s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e709aff8-b538-46cd-9aff-09bdb0efd168 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85.4cc8f343-bfa8-4484-afd5-5e69b6cb89e1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:24 devstack sudo[108961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85.4cc8f343-bfa8-4484-afd5-5e69b6cb89e1 Sep 28 18:30:24 devstack sudo[108961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:25 devstack sudo[108961]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e709aff8-b538-46cd-9aff-09bdb0efd168 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85.4cc8f343-bfa8-4484-afd5-5e69b6cb89e1" returned: 0 in 0.307s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:25 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-e709aff8-b538-46cd-9aff-09bdb0efd168 tempest-ProjectReaderTests-1876210163 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85.4cc8f343-bfa8-4484-afd5-5e69b6cb89e1 is being set with open permissions: ugo+rw Sep 28 18:30:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e709aff8-b538-46cd-9aff-09bdb0efd168 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85.4cc8f343-bfa8-4484-afd5-5e69b6cb89e1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:25 devstack sudo[108966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85.4cc8f343-bfa8-4484-afd5-5e69b6cb89e1 Sep 28 18:30:25 devstack sudo[108966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:25 devstack sudo[108966]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e709aff8-b538-46cd-9aff-09bdb0efd168 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85.4cc8f343-bfa8-4484-afd5-5e69b6cb89e1" returned: 0 in 0.260s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e709aff8-b538-46cd-9aff-09bdb0efd168 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:25 devstack sudo[108969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85.info Sep 28 18:30:25 devstack sudo[108969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:25 devstack sudo[108969]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e709aff8-b538-46cd-9aff-09bdb0efd168 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85.info" returned: 0 in 0.278s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:25 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-e709aff8-b538-46cd-9aff-09bdb0efd168 tempest-ProjectReaderTests-1876210163 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85.info is being set with open permissions: ugo+rw Sep 28 18:30:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e709aff8-b538-46cd-9aff-09bdb0efd168 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:25 devstack sudo[108972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85.info Sep 28 18:30:25 devstack sudo[108972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:25 devstack sudo[108972]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e709aff8-b538-46cd-9aff-09bdb0efd168 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85.info" returned: 0 in 0.270s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e709aff8-b538-46cd-9aff-09bdb0efd168 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.019s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:25 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-e709aff8-b538-46cd-9aff-09bdb0efd168 tempest-ProjectReaderTests-1876210163 None] Create snapshot completed successfully Sep 28 18:30:27 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-df4f83f9-617d-4ac8-98db-fcbc6e3637e6 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "cinder-4cc8f343-bfa8-4484-afd5-5e69b6cb89e1-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:27 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-df4f83f9-617d-4ac8-98db-fcbc6e3637e6 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-4cc8f343-bfa8-4484-afd5-5e69b6cb89e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:27 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-df4f83f9-617d-4ac8-98db-fcbc6e3637e6 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "cinder-quobyte-92db51bb-14a4-44a5-92a9-fb8e44ba4e85" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:27 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-df4f83f9-617d-4ac8-98db-fcbc6e3637e6 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-92db51bb-14a4-44a5-92a9-fb8e44ba4e85" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:27 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-df4f83f9-617d-4ac8-98db-fcbc6e3637e6 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "cinder-quobyte-4cc8f343-bfa8-4484-afd5-5e69b6cb89e1" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:27 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-df4f83f9-617d-4ac8-98db-fcbc6e3637e6 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-4cc8f343-bfa8-4484-afd5-5e69b6cb89e1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-df4f83f9-617d-4ac8-98db-fcbc6e3637e6 tempest-ProjectReaderTests-1876210163 None] Deleting offline snapshot 4cc8f343-bfa8-4484-afd5-5e69b6cb89e1 of volume 92db51bb-14a4-44a5-92a9-fb8e44ba4e85 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:30:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-df4f83f9-617d-4ac8-98db-fcbc6e3637e6 tempest-ProjectReaderTests-1876210163 None] snapshot_file for this snap is: volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85.4cc8f343-bfa8-4484-afd5-5e69b6cb89e1 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:30:27 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[95679082-0d1f-44cc-b2b2-c9b9af6a3e73]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-df4f83f9-617d-4ac8-98db-fcbc6e3637e6 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85.4cc8f343-bfa8-4484-afd5-5e69b6cb89e1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:27 devstack sudo[108975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85.4cc8f343-bfa8-4484-afd5-5e69b6cb89e1 Sep 28 18:30:27 devstack sudo[108975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:27 devstack sudo[108975]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-df4f83f9-617d-4ac8-98db-fcbc6e3637e6 tempest-ProjectReaderTests-1876210163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85.4cc8f343-bfa8-4484-afd5-5e69b6cb89e1" returned: 0 in 0.365s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-df4f83f9-617d-4ac8-98db-fcbc6e3637e6 tempest-ProjectReaderTests-1876210163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:30:27 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[722b6feb-790a-4cb4-854e-a01a5766785b]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-df4f83f9-617d-4ac8-98db-fcbc6e3637e6 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:27 devstack sudo[108980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85 Sep 28 18:30:27 devstack sudo[108980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:28 devstack sudo[108980]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-df4f83f9-617d-4ac8-98db-fcbc6e3637e6 tempest-ProjectReaderTests-1876210163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85" returned: 0 in 0.411s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-df4f83f9-617d-4ac8-98db-fcbc6e3637e6 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85.4cc8f343-bfa8-4484-afd5-5e69b6cb89e1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:28 devstack sudo[108985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85.4cc8f343-bfa8-4484-afd5-5e69b6cb89e1 Sep 28 18:30:28 devstack sudo[108985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:28 devstack sudo[108985]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-df4f83f9-617d-4ac8-98db-fcbc6e3637e6 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85.4cc8f343-bfa8-4484-afd5-5e69b6cb89e1" returned: 0 in 0.383s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-df4f83f9-617d-4ac8-98db-fcbc6e3637e6 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85.4cc8f343-bfa8-4484-afd5-5e69b6cb89e1 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:28 devstack sudo[108990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85.4cc8f343-bfa8-4484-afd5-5e69b6cb89e1 Sep 28 18:30:28 devstack sudo[108990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:28 devstack sudo[108990]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-df4f83f9-617d-4ac8-98db-fcbc6e3637e6 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85.4cc8f343-bfa8-4484-afd5-5e69b6cb89e1" returned: 0 in 0.273s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:28 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-df4f83f9-617d-4ac8-98db-fcbc6e3637e6 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-4cc8f343-bfa8-4484-afd5-5e69b6cb89e1" released by "_delete_snapshot" :: held 1.536s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:28 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-df4f83f9-617d-4ac8-98db-fcbc6e3637e6 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-92db51bb-14a4-44a5-92a9-fb8e44ba4e85" released by "delete_snapshot" :: held 1.559s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:28 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-df4f83f9-617d-4ac8-98db-fcbc6e3637e6 tempest-ProjectReaderTests-1876210163 None] Created reservations ['99c084ec-62b2-4f16-9c92-1724c9f079d9', 'cd86b176-4ffb-4d22-a3db-24f54e2b5632', '8f2ca9b8-0866-41ae-92e7-2365963dba7c', '0db61639-2f15-40e3-9870-11a288b5b842'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:28 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-df4f83f9-617d-4ac8-98db-fcbc6e3637e6 tempest-ProjectReaderTests-1876210163 None] Delete snapshot completed successfully. Sep 28 18:30:28 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-df4f83f9-617d-4ac8-98db-fcbc6e3637e6 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-4cc8f343-bfa8-4484-afd5-5e69b6cb89e1-delete_snapshot" released by "delete_snapshot" :: held 1.726s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:29 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-89f9e213-07b1-48a0-b3c0-a501bb4e8a4b tempest-ProjectReaderTests-1876210163 None] Acquiring lock "cinder-92db51bb-14a4-44a5-92a9-fb8e44ba4e85-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:29 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-89f9e213-07b1-48a0-b3c0-a501bb4e8a4b tempest-ProjectReaderTests-1876210163 None] Lock "cinder-92db51bb-14a4-44a5-92a9-fb8e44ba4e85-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:29 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-89f9e213-07b1-48a0-b3c0-a501bb4e8a4b tempest-ProjectReaderTests-1876210163 None] Acquiring lock "cinder-quobyte-92db51bb-14a4-44a5-92a9-fb8e44ba4e85" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:29 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-89f9e213-07b1-48a0-b3c0-a501bb4e8a4b tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-92db51bb-14a4-44a5-92a9-fb8e44ba4e85" acquired by "delete_volume" :: waited 0.018s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:29 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b83df7-da6b-4447-8548-167e1669b8ce]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-89f9e213-07b1-48a0-b3c0-a501bb4e8a4b tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:29 devstack sudo[108993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85 Sep 28 18:30:29 devstack sudo[108993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:29 devstack sudo[108993]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-89f9e213-07b1-48a0-b3c0-a501bb4e8a4b tempest-ProjectReaderTests-1876210163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85" returned: 0 in 0.415s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-89f9e213-07b1-48a0-b3c0-a501bb4e8a4b tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:29 devstack sudo[108998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85 Sep 28 18:30:29 devstack sudo[108998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:30 devstack sudo[108998]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-89f9e213-07b1-48a0-b3c0-a501bb4e8a4b tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-92db51bb-14a4-44a5-92a9-fb8e44ba4e85" returned: 0 in 0.285s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:30 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-89f9e213-07b1-48a0-b3c0-a501bb4e8a4b tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-92db51bb-14a4-44a5-92a9-fb8e44ba4e85" released by "delete_volume" :: held 0.770s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:30 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-89f9e213-07b1-48a0-b3c0-a501bb4e8a4b tempest-ProjectReaderTests-1876210163 None] Created reservations ['3ff6f88b-84f6-4fc9-aa27-1a078030c787', 'a4b74c25-eed8-4ec8-8fff-104c367cb163', 'c64ecc04-27c8-46b4-841d-f39647283d76', '31af621b-f269-472a-832c-cd7fa8f32bae'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-89f9e213-07b1-48a0-b3c0-a501bb4e8a4b tempest-ProjectReaderTests-1876210163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-89f9e213-07b1-48a0-b3c0-a501bb4e8a4b tempest-ProjectReaderTests-1876210163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:30 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-89f9e213-07b1-48a0-b3c0-a501bb4e8a4b tempest-ProjectReaderTests-1876210163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:30 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-89f9e213-07b1-48a0-b3c0-a501bb4e8a4b tempest-ProjectReaderTests-1876210163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-89f9e213-07b1-48a0-b3c0-a501bb4e8a4b tempest-ProjectReaderTests-1876210163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-89f9e213-07b1-48a0-b3c0-a501bb4e8a4b tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:30 devstack sudo[109001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:30:30 devstack sudo[109001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:30 devstack sudo[109001]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-89f9e213-07b1-48a0-b3c0-a501bb4e8a4b tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.295s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:30 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-89f9e213-07b1-48a0-b3c0-a501bb4e8a4b tempest-ProjectReaderTests-1876210163 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:30 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-89f9e213-07b1-48a0-b3c0-a501bb4e8a4b tempest-ProjectReaderTests-1876210163 None] Deleted volume successfully. Sep 28 18:30:30 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-89f9e213-07b1-48a0-b3c0-a501bb4e8a4b tempest-ProjectReaderTests-1876210163 None] Lock "cinder-92db51bb-14a4-44a5-92a9-fb8e44ba4e85-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Flow 'volume_create_manager' (f9c6d21e-aa11-40d0-92aa-73dd915ca070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c395b63-9d94-430b-b6a2-18967debe99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c395b63-9d94-430b-b6a2-18967debe99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1714392157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f9d71d1-b52a-420a-b386-7aa09dfa48ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47dda4210e6c4fe683163b4f44ea31a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:31Z,use_quota=True,user_id='c99d41dc85e54f25a934b4454714bd2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebcd93d9-73fa-446d-9072-3f512d0c1a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebcd93d9-73fa-446d-9072-3f512d0c1a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f39d77-7575-4c36-a633-c721003515ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f39d77-7575-4c36-a633-c721003515ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f9d71d1-b52a-420a-b386-7aa09dfa48ab', 'volume_name': 'volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a4fab2-c6b7-4714-8886-a218eae57f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a4fab2-c6b7-4714-8886-a218eae57f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3690b334-19f6-434c-ab3c-f924a86b160e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:31 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Volume 2f9d71d1-b52a-420a-b386-7aa09dfa48ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab', 'volume_size': 1} Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1714392157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f9d71d1-b52a-420a-b386-7aa09dfa48ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47dda4210e6c4fe683163b4f44ea31a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:31Z,use_quota=True,user_id='c99d41dc85e54f25a934b4454714bd2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Creating volume 2f9d71d1-b52a-420a-b386-7aa09dfa48ab {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:31 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:31 devstack sudo[109004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab 1073741824 Sep 28 18:30:31 devstack sudo[109004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:31 devstack sudo[109004]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab 1073741824" returned: 0 in 0.498s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:31 devstack sudo[109010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab Sep 28 18:30:31 devstack sudo[109010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:31 devstack sudo[109010]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab" returned: 0 in 0.276s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3690b334-19f6-434c-ab3c-f924a86b160e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619a86ca-c36f-4ad5-a75d-156e63bd5339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:31 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Volume volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab (2f9d71d1-b52a-420a-b386-7aa09dfa48ab): created successfully Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619a86ca-c36f-4ad5-a75d-156e63bd5339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Flow 'volume_create_manager' (f9c6d21e-aa11-40d0-92aa-73dd915ca070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:31 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-22582d7c-ec57-4d1e-a174-95c7d23d26a8 tempest-ProjectReaderTests-1876210163 None] Created volume successfully. Sep 28 18:30:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-67eb32ec-450d-4128-a3a9-6c4c22081ab9 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-67eb32ec-450d-4128-a3a9-6c4c22081ab9 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-67eb32ec-450d-4128-a3a9-6c4c22081ab9 tempest-ProjectReaderTests-1876210163 None] Creating offline snapshot 29271579-5d36-4d51-be3e-3151a9094d80 of volume 2f9d71d1-b52a-420a-b386-7aa09dfa48ab {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:30:33 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ebf80a-74d9-4377-a287-375350816796]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-67eb32ec-450d-4128-a3a9-6c4c22081ab9 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:33 devstack sudo[109014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab Sep 28 18:30:33 devstack sudo[109014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:33 devstack sudo[109014]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-67eb32ec-450d-4128-a3a9-6c4c22081ab9 tempest-ProjectReaderTests-1876210163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab" returned: 0 in 0.395s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-67eb32ec-450d-4128-a3a9-6c4c22081ab9 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab.29271579-5d36-4d51-be3e-3151a9094d80 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:33 devstack sudo[109019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab.29271579-5d36-4d51-be3e-3151a9094d80 1G Sep 28 18:30:33 devstack sudo[109019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:34 devstack sudo[109019]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-67eb32ec-450d-4128-a3a9-6c4c22081ab9 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab.29271579-5d36-4d51-be3e-3151a9094d80 1G" returned: 0 in 0.494s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-67eb32ec-450d-4128-a3a9-6c4c22081ab9 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab.29271579-5d36-4d51-be3e-3151a9094d80 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:34 devstack sudo[109025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab.29271579-5d36-4d51-be3e-3151a9094d80 Sep 28 18:30:34 devstack sudo[109025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:34 devstack sudo[109025]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-67eb32ec-450d-4128-a3a9-6c4c22081ab9 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab.29271579-5d36-4d51-be3e-3151a9094d80" returned: 0 in 0.383s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:34 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-67eb32ec-450d-4128-a3a9-6c4c22081ab9 tempest-ProjectReaderTests-1876210163 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab.29271579-5d36-4d51-be3e-3151a9094d80 is being set with open permissions: ugo+rw Sep 28 18:30:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-67eb32ec-450d-4128-a3a9-6c4c22081ab9 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab.29271579-5d36-4d51-be3e-3151a9094d80 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:34 devstack sudo[109030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab.29271579-5d36-4d51-be3e-3151a9094d80 Sep 28 18:30:34 devstack sudo[109030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:34 devstack sudo[109030]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-67eb32ec-450d-4128-a3a9-6c4c22081ab9 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab.29271579-5d36-4d51-be3e-3151a9094d80" returned: 0 in 0.341s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-67eb32ec-450d-4128-a3a9-6c4c22081ab9 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:35 devstack sudo[109034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab.info Sep 28 18:30:35 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:35 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-67eb32ec-450d-4128-a3a9-6c4c22081ab9 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab.info" returned: 0 in 0.317s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:35 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-67eb32ec-450d-4128-a3a9-6c4c22081ab9 tempest-ProjectReaderTests-1876210163 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab.info is being set with open permissions: ugo+rw Sep 28 18:30:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-67eb32ec-450d-4128-a3a9-6c4c22081ab9 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:35 devstack sudo[109037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab.info Sep 28 18:30:35 devstack sudo[109037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:35 devstack sudo[109037]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-67eb32ec-450d-4128-a3a9-6c4c22081ab9 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab.info" returned: 0 in 0.292s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:35 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-67eb32ec-450d-4128-a3a9-6c4c22081ab9 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.333s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:35 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-67eb32ec-450d-4128-a3a9-6c4c22081ab9 tempest-ProjectReaderTests-1876210163 None] Create snapshot completed successfully Sep 28 18:30:36 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bc9e5907-a5b0-4734-811a-78324d32f92b tempest-ProjectReaderTests-1876210163 None] Acquiring lock "cinder-29271579-5d36-4d51-be3e-3151a9094d80-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:36 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bc9e5907-a5b0-4734-811a-78324d32f92b tempest-ProjectReaderTests-1876210163 None] Lock "cinder-29271579-5d36-4d51-be3e-3151a9094d80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:36 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bc9e5907-a5b0-4734-811a-78324d32f92b tempest-ProjectReaderTests-1876210163 None] Acquiring lock "cinder-quobyte-2f9d71d1-b52a-420a-b386-7aa09dfa48ab" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:36 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bc9e5907-a5b0-4734-811a-78324d32f92b tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-2f9d71d1-b52a-420a-b386-7aa09dfa48ab" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:36 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bc9e5907-a5b0-4734-811a-78324d32f92b tempest-ProjectReaderTests-1876210163 None] Acquiring lock "cinder-quobyte-29271579-5d36-4d51-be3e-3151a9094d80" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:36 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bc9e5907-a5b0-4734-811a-78324d32f92b tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-29271579-5d36-4d51-be3e-3151a9094d80" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-bc9e5907-a5b0-4734-811a-78324d32f92b tempest-ProjectReaderTests-1876210163 None] Deleting offline snapshot 29271579-5d36-4d51-be3e-3151a9094d80 of volume 2f9d71d1-b52a-420a-b386-7aa09dfa48ab {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:30:36 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-bc9e5907-a5b0-4734-811a-78324d32f92b tempest-ProjectReaderTests-1876210163 None] snapshot_file for this snap is: volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab.29271579-5d36-4d51-be3e-3151a9094d80 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:30:36 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd524ee0-eac9-4d53-9d73-5c1041f42083]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:36 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bc9e5907-a5b0-4734-811a-78324d32f92b tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab.29271579-5d36-4d51-be3e-3151a9094d80 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:36 devstack sudo[109040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab.29271579-5d36-4d51-be3e-3151a9094d80 Sep 28 18:30:36 devstack sudo[109040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:37 devstack sudo[109040]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bc9e5907-a5b0-4734-811a-78324d32f92b tempest-ProjectReaderTests-1876210163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab.29271579-5d36-4d51-be3e-3151a9094d80" returned: 0 in 0.431s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:37 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-bc9e5907-a5b0-4734-811a-78324d32f92b tempest-ProjectReaderTests-1876210163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:30:37 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a863d1-d171-4ddd-a6b3-d939b163b7ca]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bc9e5907-a5b0-4734-811a-78324d32f92b tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:37 devstack sudo[109045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab Sep 28 18:30:37 devstack sudo[109045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:37 devstack sudo[109045]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bc9e5907-a5b0-4734-811a-78324d32f92b tempest-ProjectReaderTests-1876210163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab" returned: 0 in 0.432s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bc9e5907-a5b0-4734-811a-78324d32f92b tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab.29271579-5d36-4d51-be3e-3151a9094d80 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:37 devstack sudo[109050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab.29271579-5d36-4d51-be3e-3151a9094d80 Sep 28 18:30:37 devstack sudo[109050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:37 devstack sudo[109050]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bc9e5907-a5b0-4734-811a-78324d32f92b tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab.29271579-5d36-4d51-be3e-3151a9094d80" returned: 0 in 0.357s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:37 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bc9e5907-a5b0-4734-811a-78324d32f92b tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab.29271579-5d36-4d51-be3e-3151a9094d80 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:37 devstack sudo[109055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab.29271579-5d36-4d51-be3e-3151a9094d80 Sep 28 18:30:37 devstack sudo[109055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:38 devstack sudo[109055]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bc9e5907-a5b0-4734-811a-78324d32f92b tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab.29271579-5d36-4d51-be3e-3151a9094d80" returned: 0 in 0.274s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:38 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bc9e5907-a5b0-4734-811a-78324d32f92b tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-29271579-5d36-4d51-be3e-3151a9094d80" released by "_delete_snapshot" :: held 1.614s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:38 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bc9e5907-a5b0-4734-811a-78324d32f92b tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-2f9d71d1-b52a-420a-b386-7aa09dfa48ab" released by "delete_snapshot" :: held 1.648s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:38 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-bc9e5907-a5b0-4734-811a-78324d32f92b tempest-ProjectReaderTests-1876210163 None] Created reservations ['3c456f27-0b8c-414f-9dbb-af2164909c78', '2951c56a-4c6c-47fe-950d-49bd18488f29', 'dc26734a-2d92-4761-bf5e-92a820d9c536', '4af4bf95-5995-4731-8dce-d3f9e50bacf4'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:38 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-bc9e5907-a5b0-4734-811a-78324d32f92b tempest-ProjectReaderTests-1876210163 None] Delete snapshot completed successfully. Sep 28 18:30:38 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bc9e5907-a5b0-4734-811a-78324d32f92b tempest-ProjectReaderTests-1876210163 None] Lock "cinder-29271579-5d36-4d51-be3e-3151a9094d80-delete_snapshot" released by "delete_snapshot" :: held 1.837s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:38 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ffc77643-3926-4901-8154-60930cb965a7 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "cinder-2f9d71d1-b52a-420a-b386-7aa09dfa48ab-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:38 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ffc77643-3926-4901-8154-60930cb965a7 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-2f9d71d1-b52a-420a-b386-7aa09dfa48ab-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:38 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ffc77643-3926-4901-8154-60930cb965a7 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "cinder-quobyte-2f9d71d1-b52a-420a-b386-7aa09dfa48ab" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:38 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ffc77643-3926-4901-8154-60930cb965a7 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-2f9d71d1-b52a-420a-b386-7aa09dfa48ab" acquired by "delete_volume" :: waited 0.021s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:38 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f701bd-f4cb-40a4-8e2b-ef0c12577bce]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:38 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ffc77643-3926-4901-8154-60930cb965a7 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:38 devstack sudo[109058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab Sep 28 18:30:38 devstack sudo[109058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:39 devstack sudo[109058]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ffc77643-3926-4901-8154-60930cb965a7 tempest-ProjectReaderTests-1876210163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab" returned: 0 in 0.427s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ffc77643-3926-4901-8154-60930cb965a7 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:39 devstack sudo[109063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab Sep 28 18:30:39 devstack sudo[109063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:39 devstack sudo[109063]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ffc77643-3926-4901-8154-60930cb965a7 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-2f9d71d1-b52a-420a-b386-7aa09dfa48ab" returned: 0 in 0.319s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:39 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ffc77643-3926-4901-8154-60930cb965a7 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-2f9d71d1-b52a-420a-b386-7aa09dfa48ab" released by "delete_volume" :: held 0.820s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:39 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-ffc77643-3926-4901-8154-60930cb965a7 tempest-ProjectReaderTests-1876210163 None] Created reservations ['99054c6b-eb2e-4da9-a342-b6924823c415', '35d312b2-a90c-4b0c-9c1c-5af66c0676dc', 'b1ba26cd-b38a-46ad-bddc-38ccee22b63d', '0a4212dc-1ccc-446e-9550-3a5c841c04b3'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ffc77643-3926-4901-8154-60930cb965a7 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ffc77643-3926-4901-8154-60930cb965a7 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ffc77643-3926-4901-8154-60930cb965a7 tempest-ProjectReaderTests-1876210163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:39 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ffc77643-3926-4901-8154-60930cb965a7 tempest-ProjectReaderTests-1876210163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ffc77643-3926-4901-8154-60930cb965a7 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:39 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ffc77643-3926-4901-8154-60930cb965a7 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:39 devstack sudo[109066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:30:39 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:40 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ffc77643-3926-4901-8154-60930cb965a7 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.282s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:40 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-ffc77643-3926-4901-8154-60930cb965a7 tempest-ProjectReaderTests-1876210163 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:40 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-ffc77643-3926-4901-8154-60930cb965a7 tempest-ProjectReaderTests-1876210163 None] Deleted volume successfully. Sep 28 18:30:40 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ffc77643-3926-4901-8154-60930cb965a7 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-2f9d71d1-b52a-420a-b386-7aa09dfa48ab-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:40 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:40 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Flow 'volume_create_manager' (4ca55987-d276-4bdd-b645-8b80c0b65cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:40 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e30e824-5908-42d2-a576-40ff378acc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:40 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e30e824-5908-42d2-a576-40ff378acc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-801311640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d87f69c7-64f2-48ac-b4a0-e2f7aec59713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47dda4210e6c4fe683163b4f44ea31a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:40Z,use_quota=True,user_id='c99d41dc85e54f25a934b4454714bd2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:40 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a6481c9-24d3-4d12-ae15-950856a8d9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:40 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a6481c9-24d3-4d12-ae15-950856a8d9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:40 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bcf8c8d-87ba-40f1-94a3-79d60461886c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:40 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bcf8c8d-87ba-40f1-94a3-79d60461886c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd87f69c7-64f2-48ac-b4a0-e2f7aec59713', 'volume_name': 'volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:40 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642cf841-971c-41cd-98b8-7181597ccee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:40 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642cf841-971c-41cd-98b8-7181597ccee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:40 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a7eff6d-a157-4472-a287-9c226fa16807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:40 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Volume d87f69c7-64f2-48ac-b4a0-e2f7aec59713: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713', 'volume_size': 1} Sep 28 18:30:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:40 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-801311640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d87f69c7-64f2-48ac-b4a0-e2f7aec59713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47dda4210e6c4fe683163b4f44ea31a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:40Z,use_quota=True,user_id='c99d41dc85e54f25a934b4454714bd2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:30:40 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Creating volume d87f69c7-64f2-48ac-b4a0-e2f7aec59713 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:30:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:40 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:40 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:40 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:40 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:30:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:40 devstack sudo[109069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713 1073741824 Sep 28 18:30:40 devstack sudo[109069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:40 devstack sudo[109069]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:40 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713 1073741824" returned: 0 in 0.457s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:41 devstack sudo[109075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713 Sep 28 18:30:41 devstack sudo[109075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:41 devstack sudo[109075]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713" returned: 0 in 0.280s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:41 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:30:41 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a7eff6d-a157-4472-a287-9c226fa16807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48449739-1d91-4ecf-9cf3-1447eafa69ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:41 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Volume volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713 (d87f69c7-64f2-48ac-b4a0-e2f7aec59713): created successfully Sep 28 18:30:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48449739-1d91-4ecf-9cf3-1447eafa69ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:41 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Flow 'volume_create_manager' (4ca55987-d276-4bdd-b645-8b80c0b65cd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:41 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-fffc67a9-3b34-4102-bf29-d19c1de0e52d tempest-ProjectReaderTests-1876210163 None] Created volume successfully. Sep 28 18:30:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2650a37f-2220-4c09-b92b-8a461a7667bf tempest-ProjectReaderTests-1876210163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2650a37f-2220-4c09-b92b-8a461a7667bf tempest-ProjectReaderTests-1876210163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:42 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-2650a37f-2220-4c09-b92b-8a461a7667bf tempest-ProjectReaderTests-1876210163 None] Creating offline snapshot 46302a0e-0194-4c75-98b7-ee4e5fe24e65 of volume d87f69c7-64f2-48ac-b4a0-e2f7aec59713 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:30:42 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b3dacd-80d1-46b9-8d98-46c221408c1d]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:42 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2650a37f-2220-4c09-b92b-8a461a7667bf tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:42 devstack sudo[109080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713 Sep 28 18:30:42 devstack sudo[109080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:43 devstack sudo[109080]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2650a37f-2220-4c09-b92b-8a461a7667bf tempest-ProjectReaderTests-1876210163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713" returned: 0 in 0.439s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2650a37f-2220-4c09-b92b-8a461a7667bf tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713.46302a0e-0194-4c75-98b7-ee4e5fe24e65 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:43 devstack sudo[109085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713.46302a0e-0194-4c75-98b7-ee4e5fe24e65 1G Sep 28 18:30:43 devstack sudo[109085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:43 devstack sudo[109085]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2650a37f-2220-4c09-b92b-8a461a7667bf tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713.46302a0e-0194-4c75-98b7-ee4e5fe24e65 1G" returned: 0 in 0.479s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:43 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2650a37f-2220-4c09-b92b-8a461a7667bf tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713.46302a0e-0194-4c75-98b7-ee4e5fe24e65 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:43 devstack sudo[109090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713.46302a0e-0194-4c75-98b7-ee4e5fe24e65 Sep 28 18:30:43 devstack sudo[109090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:44 devstack sudo[109090]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2650a37f-2220-4c09-b92b-8a461a7667bf tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713.46302a0e-0194-4c75-98b7-ee4e5fe24e65" returned: 0 in 0.357s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:44 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-2650a37f-2220-4c09-b92b-8a461a7667bf tempest-ProjectReaderTests-1876210163 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713.46302a0e-0194-4c75-98b7-ee4e5fe24e65 is being set with open permissions: ugo+rw Sep 28 18:30:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2650a37f-2220-4c09-b92b-8a461a7667bf tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713.46302a0e-0194-4c75-98b7-ee4e5fe24e65 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:44 devstack sudo[109095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713.46302a0e-0194-4c75-98b7-ee4e5fe24e65 Sep 28 18:30:44 devstack sudo[109095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:44 devstack sudo[109095]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2650a37f-2220-4c09-b92b-8a461a7667bf tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713.46302a0e-0194-4c75-98b7-ee4e5fe24e65" returned: 0 in 0.272s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2650a37f-2220-4c09-b92b-8a461a7667bf tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:44 devstack sudo[109098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713.info Sep 28 18:30:44 devstack sudo[109098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:44 devstack sudo[109098]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2650a37f-2220-4c09-b92b-8a461a7667bf tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713.info" returned: 0 in 0.285s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:44 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-2650a37f-2220-4c09-b92b-8a461a7667bf tempest-ProjectReaderTests-1876210163 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713.info is being set with open permissions: ugo+rw Sep 28 18:30:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2650a37f-2220-4c09-b92b-8a461a7667bf tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:44 devstack sudo[109101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713.info Sep 28 18:30:44 devstack sudo[109101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:44 devstack sudo[109101]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2650a37f-2220-4c09-b92b-8a461a7667bf tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713.info" returned: 0 in 0.271s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:44 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2650a37f-2220-4c09-b92b-8a461a7667bf tempest-ProjectReaderTests-1876210163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.200s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:44 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-2650a37f-2220-4c09-b92b-8a461a7667bf tempest-ProjectReaderTests-1876210163 None] Create snapshot completed successfully Sep 28 18:30:45 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-58db3f9a-5b37-4ce3-8510-fdef1c46a5e3 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "cinder-46302a0e-0194-4c75-98b7-ee4e5fe24e65-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:45 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-58db3f9a-5b37-4ce3-8510-fdef1c46a5e3 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-46302a0e-0194-4c75-98b7-ee4e5fe24e65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:45 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-58db3f9a-5b37-4ce3-8510-fdef1c46a5e3 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "cinder-quobyte-d87f69c7-64f2-48ac-b4a0-e2f7aec59713" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:45 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-58db3f9a-5b37-4ce3-8510-fdef1c46a5e3 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-d87f69c7-64f2-48ac-b4a0-e2f7aec59713" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:45 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-58db3f9a-5b37-4ce3-8510-fdef1c46a5e3 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "cinder-quobyte-46302a0e-0194-4c75-98b7-ee4e5fe24e65" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:45 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-58db3f9a-5b37-4ce3-8510-fdef1c46a5e3 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-46302a0e-0194-4c75-98b7-ee4e5fe24e65" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:45 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-58db3f9a-5b37-4ce3-8510-fdef1c46a5e3 tempest-ProjectReaderTests-1876210163 None] Deleting offline snapshot 46302a0e-0194-4c75-98b7-ee4e5fe24e65 of volume d87f69c7-64f2-48ac-b4a0-e2f7aec59713 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:30:46 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-58db3f9a-5b37-4ce3-8510-fdef1c46a5e3 tempest-ProjectReaderTests-1876210163 None] snapshot_file for this snap is: volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713.46302a0e-0194-4c75-98b7-ee4e5fe24e65 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:30:46 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebe466f-4e93-4219-a15a-31390c423001]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-58db3f9a-5b37-4ce3-8510-fdef1c46a5e3 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713.46302a0e-0194-4c75-98b7-ee4e5fe24e65 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:46 devstack sudo[109106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713.46302a0e-0194-4c75-98b7-ee4e5fe24e65 Sep 28 18:30:46 devstack sudo[109106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:46 devstack sudo[109106]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-58db3f9a-5b37-4ce3-8510-fdef1c46a5e3 tempest-ProjectReaderTests-1876210163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713.46302a0e-0194-4c75-98b7-ee4e5fe24e65" returned: 0 in 0.386s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:46 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-58db3f9a-5b37-4ce3-8510-fdef1c46a5e3 tempest-ProjectReaderTests-1876210163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:30:46 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06d271f-a56b-4481-a055-1ebf9a1ab082]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-58db3f9a-5b37-4ce3-8510-fdef1c46a5e3 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:46 devstack sudo[109111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713 Sep 28 18:30:46 devstack sudo[109111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:46 devstack sudo[109111]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-58db3f9a-5b37-4ce3-8510-fdef1c46a5e3 tempest-ProjectReaderTests-1876210163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713" returned: 0 in 0.390s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:46 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-58db3f9a-5b37-4ce3-8510-fdef1c46a5e3 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713.46302a0e-0194-4c75-98b7-ee4e5fe24e65 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:46 devstack sudo[109116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713.46302a0e-0194-4c75-98b7-ee4e5fe24e65 Sep 28 18:30:46 devstack sudo[109116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:47 devstack sudo[109116]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-58db3f9a-5b37-4ce3-8510-fdef1c46a5e3 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713.46302a0e-0194-4c75-98b7-ee4e5fe24e65" returned: 0 in 0.402s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-58db3f9a-5b37-4ce3-8510-fdef1c46a5e3 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713.46302a0e-0194-4c75-98b7-ee4e5fe24e65 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:47 devstack sudo[109121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713.46302a0e-0194-4c75-98b7-ee4e5fe24e65 Sep 28 18:30:47 devstack sudo[109121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:47 devstack sudo[109121]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:47 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-58db3f9a-5b37-4ce3-8510-fdef1c46a5e3 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713.46302a0e-0194-4c75-98b7-ee4e5fe24e65" returned: 0 in 0.291s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-58db3f9a-5b37-4ce3-8510-fdef1c46a5e3 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-46302a0e-0194-4c75-98b7-ee4e5fe24e65" released by "_delete_snapshot" :: held 1.572s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-58db3f9a-5b37-4ce3-8510-fdef1c46a5e3 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-d87f69c7-64f2-48ac-b4a0-e2f7aec59713" released by "delete_snapshot" :: held 1.599s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:47 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-58db3f9a-5b37-4ce3-8510-fdef1c46a5e3 tempest-ProjectReaderTests-1876210163 None] Created reservations ['7662639d-fc5f-4a9f-bf3b-7f7920ef870d', '5275cb33-3cca-47a1-ad10-a48b7f818ebd', '2f237ef4-0c02-4f56-a1aa-d6c42c546157', '015763ac-3f35-410c-8c47-2eb9b9868459'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:47 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-58db3f9a-5b37-4ce3-8510-fdef1c46a5e3 tempest-ProjectReaderTests-1876210163 None] Delete snapshot completed successfully. Sep 28 18:30:47 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-58db3f9a-5b37-4ce3-8510-fdef1c46a5e3 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-46302a0e-0194-4c75-98b7-ee4e5fe24e65-delete_snapshot" released by "delete_snapshot" :: held 1.767s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:48 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-01449801-3caf-40d4-9d6b-b77fd41b0d42 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "cinder-d87f69c7-64f2-48ac-b4a0-e2f7aec59713-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:48 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-01449801-3caf-40d4-9d6b-b77fd41b0d42 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-d87f69c7-64f2-48ac-b4a0-e2f7aec59713-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:48 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-01449801-3caf-40d4-9d6b-b77fd41b0d42 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "cinder-quobyte-d87f69c7-64f2-48ac-b4a0-e2f7aec59713" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:48 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-01449801-3caf-40d4-9d6b-b77fd41b0d42 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-d87f69c7-64f2-48ac-b4a0-e2f7aec59713" acquired by "delete_volume" :: waited 0.017s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:48 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[402dda5f-d704-4b6e-a1db-702627d6e9b4]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-01449801-3caf-40d4-9d6b-b77fd41b0d42 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:48 devstack sudo[109124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713 Sep 28 18:30:48 devstack sudo[109124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:48 devstack sudo[109124]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-01449801-3caf-40d4-9d6b-b77fd41b0d42 tempest-ProjectReaderTests-1876210163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713" returned: 0 in 0.377s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-01449801-3caf-40d4-9d6b-b77fd41b0d42 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:48 devstack sudo[109129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713 Sep 28 18:30:48 devstack sudo[109129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:48 devstack sudo[109129]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:48 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-01449801-3caf-40d4-9d6b-b77fd41b0d42 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-d87f69c7-64f2-48ac-b4a0-e2f7aec59713" returned: 0 in 0.251s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-01449801-3caf-40d4-9d6b-b77fd41b0d42 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-d87f69c7-64f2-48ac-b4a0-e2f7aec59713" released by "delete_volume" :: held 0.692s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-01449801-3caf-40d4-9d6b-b77fd41b0d42 tempest-ProjectReaderTests-1876210163 None] Created reservations ['a66e8a0a-3e56-4ac2-9d60-9e291195dff3', '5d8d1025-70b7-45de-ba93-a61cf00ae238', 'eae5881c-4b5d-4df9-9b95-7dd872679414', '0b5549b7-e904-40cf-a775-d79f707471f3'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-01449801-3caf-40d4-9d6b-b77fd41b0d42 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-01449801-3caf-40d4-9d6b-b77fd41b0d42 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-01449801-3caf-40d4-9d6b-b77fd41b0d42 tempest-ProjectReaderTests-1876210163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-01449801-3caf-40d4-9d6b-b77fd41b0d42 tempest-ProjectReaderTests-1876210163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-01449801-3caf-40d4-9d6b-b77fd41b0d42 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-01449801-3caf-40d4-9d6b-b77fd41b0d42 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:49 devstack sudo[109132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:30:49 devstack sudo[109132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:49 devstack sudo[109132]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-01449801-3caf-40d4-9d6b-b77fd41b0d42 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.276s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-01449801-3caf-40d4-9d6b-b77fd41b0d42 tempest-ProjectReaderTests-1876210163 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:30:49 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-01449801-3caf-40d4-9d6b-b77fd41b0d42 tempest-ProjectReaderTests-1876210163 None] Deleted volume successfully. Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-01449801-3caf-40d4-9d6b-b77fd41b0d42 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-d87f69c7-64f2-48ac-b4a0-e2f7aec59713-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Flow 'volume_create_manager' (27c0860d-0e57-4cef-8730-32988116c0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6386b576-744a-4f2e-bec5-3d93e363937f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6386b576-744a-4f2e-bec5-3d93e363937f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2047918048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308558e9-e63f-4951-96e4-013a322b83e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47dda4210e6c4fe683163b4f44ea31a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:50Z,use_quota=True,user_id='c99d41dc85e54f25a934b4454714bd2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1818aabf-269c-4709-9eaa-d270e859fc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1818aabf-269c-4709-9eaa-d270e859fc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba29d538-5ed5-4e15-a4d3-e985211110a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba29d538-5ed5-4e15-a4d3-e985211110a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '308558e9-e63f-4951-96e4-013a322b83e7', 'volume_name': 'volume-308558e9-e63f-4951-96e4-013a322b83e7', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d57312a-7146-44ba-b70e-7bb6102ed9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d57312a-7146-44ba-b70e-7bb6102ed9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60de7d8-960c-4272-83f8-9f5c1a4d2259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:49 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Volume 308558e9-e63f-4951-96e4-013a322b83e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-308558e9-e63f-4951-96e4-013a322b83e7', 'volume_size': 1} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2047918048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308558e9-e63f-4951-96e4-013a322b83e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47dda4210e6c4fe683163b4f44ea31a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:30:50Z,use_quota=True,user_id='c99d41dc85e54f25a934b4454714bd2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Creating volume 308558e9-e63f-4951-96e4-013a322b83e7 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:30:49 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:30:49 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:49 devstack sudo[109135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7 1073741824 Sep 28 18:30:49 devstack sudo[109135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:50 devstack sudo[109135]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7 1073741824" returned: 0 in 0.471s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:50 devstack sudo[109140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7 Sep 28 18:30:50 devstack sudo[109140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:50 devstack sudo[109140]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7" returned: 0 in 0.277s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:50 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:30:50 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60de7d8-960c-4272-83f8-9f5c1a4d2259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-308558e9-e63f-4951-96e4-013a322b83e7', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c603e608-a120-4e6e-b9b5-51f93af1102f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:30:50 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Volume volume-308558e9-e63f-4951-96e4-013a322b83e7 (308558e9-e63f-4951-96e4-013a322b83e7): created successfully Sep 28 18:30:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c603e608-a120-4e6e-b9b5-51f93af1102f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:30:50 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Flow 'volume_create_manager' (27c0860d-0e57-4cef-8730-32988116c0c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:30:50 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-c3dc8930-1f12-4ec8-bd97-bc347fe62e83 tempest-ProjectReaderTests-1876210163 None] Created volume successfully. Sep 28 18:30:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-58cee5f1-c1d8-48b5-b96a-0d7e03ee1346 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:30:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-58cee5f1-c1d8-48b5-b96a-0d7e03ee1346 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:30:56 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-58cee5f1-c1d8-48b5-b96a-0d7e03ee1346 tempest-ProjectReaderTests-1876210163 None] Creating offline snapshot a77954eb-bdc5-43aa-910d-98c749a550c8 of volume 308558e9-e63f-4951-96e4-013a322b83e7 {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:30:56 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1f36b7-3b3d-4c11-9b59-7664a7c66674]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-58cee5f1-c1d8-48b5-b96a-0d7e03ee1346 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:56 devstack sudo[109144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7 Sep 28 18:30:56 devstack sudo[109144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:56 devstack sudo[109144]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-58cee5f1-c1d8-48b5-b96a-0d7e03ee1346 tempest-ProjectReaderTests-1876210163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7" returned: 0 in 0.455s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-58cee5f1-c1d8-48b5-b96a-0d7e03ee1346 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7.a77954eb-bdc5-43aa-910d-98c749a550c8 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:56 devstack sudo[109149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7.a77954eb-bdc5-43aa-910d-98c749a550c8 1G Sep 28 18:30:56 devstack sudo[109149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:56 devstack sudo[109149]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-58cee5f1-c1d8-48b5-b96a-0d7e03ee1346 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7.a77954eb-bdc5-43aa-910d-98c749a550c8 1G" returned: 0 in 0.432s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:56 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-58cee5f1-c1d8-48b5-b96a-0d7e03ee1346 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-308558e9-e63f-4951-96e4-013a322b83e7 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7.a77954eb-bdc5-43aa-910d-98c749a550c8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:56 devstack sudo[109156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-308558e9-e63f-4951-96e4-013a322b83e7 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7.a77954eb-bdc5-43aa-910d-98c749a550c8 Sep 28 18:30:56 devstack sudo[109156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:57 devstack sudo[109156]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-58cee5f1-c1d8-48b5-b96a-0d7e03ee1346 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-308558e9-e63f-4951-96e4-013a322b83e7 -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7.a77954eb-bdc5-43aa-910d-98c749a550c8" returned: 0 in 0.330s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:57 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-58cee5f1-c1d8-48b5-b96a-0d7e03ee1346 tempest-ProjectReaderTests-1876210163 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7.a77954eb-bdc5-43aa-910d-98c749a550c8 is being set with open permissions: ugo+rw Sep 28 18:30:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-58cee5f1-c1d8-48b5-b96a-0d7e03ee1346 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7.a77954eb-bdc5-43aa-910d-98c749a550c8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:57 devstack sudo[109161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7.a77954eb-bdc5-43aa-910d-98c749a550c8 Sep 28 18:30:57 devstack sudo[109161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:57 devstack sudo[109161]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-58cee5f1-c1d8-48b5-b96a-0d7e03ee1346 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7.a77954eb-bdc5-43aa-910d-98c749a550c8" returned: 0 in 0.278s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-58cee5f1-c1d8-48b5-b96a-0d7e03ee1346 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:57 devstack sudo[109164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7.info Sep 28 18:30:57 devstack sudo[109164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:57 devstack sudo[109164]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-58cee5f1-c1d8-48b5-b96a-0d7e03ee1346 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7.info" returned: 0 in 0.264s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:57 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-58cee5f1-c1d8-48b5-b96a-0d7e03ee1346 tempest-ProjectReaderTests-1876210163 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7.info is being set with open permissions: ugo+rw Sep 28 18:30:57 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-58cee5f1-c1d8-48b5-b96a-0d7e03ee1346 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:57 devstack sudo[109167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7.info Sep 28 18:30:57 devstack sudo[109167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:58 devstack sudo[109167]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-58cee5f1-c1d8-48b5-b96a-0d7e03ee1346 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7.info" returned: 0 in 0.252s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:58 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-58cee5f1-c1d8-48b5-b96a-0d7e03ee1346 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.110s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:30:58 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-58cee5f1-c1d8-48b5-b96a-0d7e03ee1346 tempest-ProjectReaderTests-1876210163 None] Create snapshot completed successfully Sep 28 18:30:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-87d17017-0da7-4deb-b0aa-276dd22f5193 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "cinder-a77954eb-bdc5-43aa-910d-98c749a550c8-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-87d17017-0da7-4deb-b0aa-276dd22f5193 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-a77954eb-bdc5-43aa-910d-98c749a550c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-87d17017-0da7-4deb-b0aa-276dd22f5193 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "cinder-quobyte-308558e9-e63f-4951-96e4-013a322b83e7" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-87d17017-0da7-4deb-b0aa-276dd22f5193 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-308558e9-e63f-4951-96e4-013a322b83e7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-87d17017-0da7-4deb-b0aa-276dd22f5193 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "cinder-quobyte-a77954eb-bdc5-43aa-910d-98c749a550c8" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:30:59 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-87d17017-0da7-4deb-b0aa-276dd22f5193 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-a77954eb-bdc5-43aa-910d-98c749a550c8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:30:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-87d17017-0da7-4deb-b0aa-276dd22f5193 tempest-ProjectReaderTests-1876210163 None] Deleting offline snapshot a77954eb-bdc5-43aa-910d-98c749a550c8 of volume 308558e9-e63f-4951-96e4-013a322b83e7 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:30:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-87d17017-0da7-4deb-b0aa-276dd22f5193 tempest-ProjectReaderTests-1876210163 None] snapshot_file for this snap is: volume-308558e9-e63f-4951-96e4-013a322b83e7.a77954eb-bdc5-43aa-910d-98c749a550c8 {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:30:59 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed31efe-4f79-4d6c-a326-a1d1600fa63b]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-87d17017-0da7-4deb-b0aa-276dd22f5193 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7.a77954eb-bdc5-43aa-910d-98c749a550c8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:59 devstack sudo[109170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7.a77954eb-bdc5-43aa-910d-98c749a550c8 Sep 28 18:30:59 devstack sudo[109170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:59 devstack sudo[109170]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-87d17017-0da7-4deb-b0aa-276dd22f5193 tempest-ProjectReaderTests-1876210163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7.a77954eb-bdc5-43aa-910d-98c749a550c8" returned: 0 in 0.404s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:59 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-87d17017-0da7-4deb-b0aa-276dd22f5193 tempest-ProjectReaderTests-1876210163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-308558e9-e63f-4951-96e4-013a322b83e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:30:59 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1836f6-360b-4b4f-856a-6060cb289358]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:30:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-87d17017-0da7-4deb-b0aa-276dd22f5193 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:30:59 devstack sudo[109175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7 Sep 28 18:30:59 devstack sudo[109175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:30:59 devstack sudo[109175]: pam_unix(sudo:session): session closed for user root Sep 28 18:30:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-87d17017-0da7-4deb-b0aa-276dd22f5193 tempest-ProjectReaderTests-1876210163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7" returned: 0 in 0.422s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:30:59 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-87d17017-0da7-4deb-b0aa-276dd22f5193 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7.a77954eb-bdc5-43aa-910d-98c749a550c8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:00 devstack sudo[109180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7.a77954eb-bdc5-43aa-910d-98c749a550c8 Sep 28 18:31:00 devstack sudo[109180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:00 devstack sudo[109180]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-87d17017-0da7-4deb-b0aa-276dd22f5193 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7.a77954eb-bdc5-43aa-910d-98c749a550c8" returned: 0 in 0.409s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-87d17017-0da7-4deb-b0aa-276dd22f5193 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7.a77954eb-bdc5-43aa-910d-98c749a550c8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:00 devstack sudo[109185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7.a77954eb-bdc5-43aa-910d-98c749a550c8 Sep 28 18:31:00 devstack sudo[109185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:00 devstack sudo[109185]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:00 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-87d17017-0da7-4deb-b0aa-276dd22f5193 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7.a77954eb-bdc5-43aa-910d-98c749a550c8" returned: 0 in 0.291s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-87d17017-0da7-4deb-b0aa-276dd22f5193 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-a77954eb-bdc5-43aa-910d-98c749a550c8" released by "_delete_snapshot" :: held 1.654s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-87d17017-0da7-4deb-b0aa-276dd22f5193 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-308558e9-e63f-4951-96e4-013a322b83e7" released by "delete_snapshot" :: held 1.686s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:00 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-87d17017-0da7-4deb-b0aa-276dd22f5193 tempest-ProjectReaderTests-1876210163 None] Created reservations ['71a68e80-e643-41e5-a673-0f5d12bfb9bd', '505de0f3-326d-4c63-9b4b-edc11d1ccf22', '7e5d229b-ea10-4319-8e46-9f5a84c44028', 'fee171d9-1ff1-461f-a251-440f1ddedaa3'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:00 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-87d17017-0da7-4deb-b0aa-276dd22f5193 tempest-ProjectReaderTests-1876210163 None] Delete snapshot completed successfully. Sep 28 18:31:00 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-87d17017-0da7-4deb-b0aa-276dd22f5193 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-a77954eb-bdc5-43aa-910d-98c749a550c8-delete_snapshot" released by "delete_snapshot" :: held 1.863s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ab84b1fa-089e-4b56-b21f-4ee5c4fd7c78 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "cinder-308558e9-e63f-4951-96e4-013a322b83e7-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ab84b1fa-089e-4b56-b21f-4ee5c4fd7c78 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-308558e9-e63f-4951-96e4-013a322b83e7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ab84b1fa-089e-4b56-b21f-4ee5c4fd7c78 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "cinder-quobyte-308558e9-e63f-4951-96e4-013a322b83e7" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:01 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ab84b1fa-089e-4b56-b21f-4ee5c4fd7c78 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-308558e9-e63f-4951-96e4-013a322b83e7" acquired by "delete_volume" :: waited 0.024s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:01 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ca69ef-4fab-4250-a25d-7f83c88af4ee]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ab84b1fa-089e-4b56-b21f-4ee5c4fd7c78 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:01 devstack sudo[109194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7 Sep 28 18:31:01 devstack sudo[109194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:01 devstack sudo[109194]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ab84b1fa-089e-4b56-b21f-4ee5c4fd7c78 tempest-ProjectReaderTests-1876210163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7" returned: 0 in 0.447s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:01 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ab84b1fa-089e-4b56-b21f-4ee5c4fd7c78 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:01 devstack sudo[109200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7 Sep 28 18:31:01 devstack sudo[109200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:02 devstack sudo[109200]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ab84b1fa-089e-4b56-b21f-4ee5c4fd7c78 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-308558e9-e63f-4951-96e4-013a322b83e7" returned: 0 in 0.297s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:02 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ab84b1fa-089e-4b56-b21f-4ee5c4fd7c78 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-308558e9-e63f-4951-96e4-013a322b83e7" released by "delete_volume" :: held 0.825s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:02 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-ab84b1fa-089e-4b56-b21f-4ee5c4fd7c78 tempest-ProjectReaderTests-1876210163 None] Created reservations ['bc60036f-a901-48d0-8a55-2257eb8f2bd2', '8c62e282-2874-48ee-a008-12877351a7d3', '381eb250-9ade-46f9-a21c-090456021344', 'f26ecfdb-bbf2-43b8-a1fb-dbb644625ada'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ab84b1fa-089e-4b56-b21f-4ee5c4fd7c78 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ab84b1fa-089e-4b56-b21f-4ee5c4fd7c78 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ab84b1fa-089e-4b56-b21f-4ee5c4fd7c78 tempest-ProjectReaderTests-1876210163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:02 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-ab84b1fa-089e-4b56-b21f-4ee5c4fd7c78 tempest-ProjectReaderTests-1876210163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-ab84b1fa-089e-4b56-b21f-4ee5c4fd7c78 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ab84b1fa-089e-4b56-b21f-4ee5c4fd7c78 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:02 devstack sudo[109203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:31:02 devstack sudo[109203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:02 devstack sudo[109203]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:02 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-ab84b1fa-089e-4b56-b21f-4ee5c4fd7c78 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.313s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:02 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-ab84b1fa-089e-4b56-b21f-4ee5c4fd7c78 tempest-ProjectReaderTests-1876210163 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:31:02 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-ab84b1fa-089e-4b56-b21f-4ee5c4fd7c78 tempest-ProjectReaderTests-1876210163 None] Deleted volume successfully. Sep 28 18:31:02 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-ab84b1fa-089e-4b56-b21f-4ee5c4fd7c78 tempest-ProjectReaderTests-1876210163 None] Lock "cinder-308558e9-e63f-4951-96e4-013a322b83e7-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:02 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:31:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Flow 'volume_create_manager' (2943254b-2305-48c0-a9fd-5ea08112ae23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (458fa990-09ae-4e24-ab01-0807703639f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (458fa990-09ae-4e24-ab01-0807703639f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2058777299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32296024-8c26-4810-b5ba-bc5b63bf069e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47dda4210e6c4fe683163b4f44ea31a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:03Z,use_quota=True,user_id='c99d41dc85e54f25a934b4454714bd2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (634b4908-c6ae-4900-a7d2-9ebbd6e9b913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:02 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (634b4908-c6ae-4900-a7d2-9ebbd6e9b913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe150b35-6291-4465-8fb3-dc6a1bf131bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe150b35-6291-4465-8fb3-dc6a1bf131bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32296024-8c26-4810-b5ba-bc5b63bf069e', 'volume_name': 'volume-32296024-8c26-4810-b5ba-bc5b63bf069e', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3917695c-3612-4fae-9143-a48b5fc8c9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3917695c-3612-4fae-9143-a48b5fc8c9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4321bfc6-b8e7-49a3-98d0-f16c49c22eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:03 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Volume 32296024-8c26-4810-b5ba-bc5b63bf069e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32296024-8c26-4810-b5ba-bc5b63bf069e', 'volume_size': 1} Sep 28 18:31:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2058777299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32296024-8c26-4810-b5ba-bc5b63bf069e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47dda4210e6c4fe683163b4f44ea31a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:03Z,use_quota=True,user_id='c99d41dc85e54f25a934b4454714bd2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:31:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Creating volume 32296024-8c26-4810-b5ba-bc5b63bf069e {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:31:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:31:03 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:31:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:03 devstack sudo[109206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e 1073741824 Sep 28 18:31:03 devstack sudo[109206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:03 devstack sudo[109206]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e 1073741824" returned: 0 in 0.453s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:03 devstack sudo[109212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e Sep 28 18:31:03 devstack sudo[109212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:03 devstack sudo[109212]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e" returned: 0 in 0.276s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:03 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:31:03 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4321bfc6-b8e7-49a3-98d0-f16c49c22eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32296024-8c26-4810-b5ba-bc5b63bf069e', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d764eed-c966-4a11-9665-ab416bdcf78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:03 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Volume volume-32296024-8c26-4810-b5ba-bc5b63bf069e (32296024-8c26-4810-b5ba-bc5b63bf069e): created successfully Sep 28 18:31:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d764eed-c966-4a11-9665-ab416bdcf78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:03 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Flow 'volume_create_manager' (2943254b-2305-48c0-a9fd-5ea08112ae23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:03 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-a02921cd-7906-4a7d-b99f-72f67e2ca572 tempest-ProjectReaderTests-1876210163 None] Created volume successfully. Sep 28 18:31:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:31:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:04 devstack sudo[109215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:31:04 devstack sudo[109215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:04 devstack sudo[109215]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.297s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:04 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:31:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager._thread_info {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:31:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread count: 28 {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:31:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread info: [<_MainThread(MainThread, started 129097393381504)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 18:31:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-96f7c4f1-dca8-4710-be56-2b9369c7a159 tempest-ProjectReaderTests-1876210163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-96f7c4f1-dca8-4710-be56-2b9369c7a159 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:05 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-96f7c4f1-dca8-4710-be56-2b9369c7a159 tempest-ProjectReaderTests-1876210163 None] Creating offline snapshot bdc47416-4891-40f0-a2a5-e868c89009db of volume 32296024-8c26-4810-b5ba-bc5b63bf069e {{(pid=86980) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 18:31:05 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4e38d7-7801-49e9-bc14-a401544f4f1f]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-96f7c4f1-dca8-4710-be56-2b9369c7a159 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:05 devstack sudo[109254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e Sep 28 18:31:05 devstack sudo[109254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:05 devstack sudo[109254]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-96f7c4f1-dca8-4710-be56-2b9369c7a159 tempest-ProjectReaderTests-1876210163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e" returned: 0 in 0.433s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:05 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-96f7c4f1-dca8-4710-be56-2b9369c7a159 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e.bdc47416-4891-40f0-a2a5-e868c89009db 1G {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:05 devstack sudo[109259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e.bdc47416-4891-40f0-a2a5-e868c89009db 1G Sep 28 18:31:05 devstack sudo[109259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:06 devstack sudo[109259]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-96f7c4f1-dca8-4710-be56-2b9369c7a159 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e.bdc47416-4891-40f0-a2a5-e868c89009db 1G" returned: 0 in 0.451s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-96f7c4f1-dca8-4710-be56-2b9369c7a159 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32296024-8c26-4810-b5ba-bc5b63bf069e -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e.bdc47416-4891-40f0-a2a5-e868c89009db {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:06 devstack sudo[109264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32296024-8c26-4810-b5ba-bc5b63bf069e -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e.bdc47416-4891-40f0-a2a5-e868c89009db Sep 28 18:31:06 devstack sudo[109264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:06 devstack sudo[109264]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-96f7c4f1-dca8-4710-be56-2b9369c7a159 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32296024-8c26-4810-b5ba-bc5b63bf069e -F qcow2 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e.bdc47416-4891-40f0-a2a5-e868c89009db" returned: 0 in 0.338s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:06 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-96f7c4f1-dca8-4710-be56-2b9369c7a159 tempest-ProjectReaderTests-1876210163 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e.bdc47416-4891-40f0-a2a5-e868c89009db is being set with open permissions: ugo+rw Sep 28 18:31:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-96f7c4f1-dca8-4710-be56-2b9369c7a159 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e.bdc47416-4891-40f0-a2a5-e868c89009db {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:06 devstack sudo[109269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e.bdc47416-4891-40f0-a2a5-e868c89009db Sep 28 18:31:06 devstack sudo[109269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:06 devstack sudo[109269]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-96f7c4f1-dca8-4710-be56-2b9369c7a159 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e.bdc47416-4891-40f0-a2a5-e868c89009db" returned: 0 in 0.301s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:06 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-96f7c4f1-dca8-4710-be56-2b9369c7a159 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:06 devstack sudo[109272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e.info Sep 28 18:31:06 devstack sudo[109272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:07 devstack sudo[109272]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-96f7c4f1-dca8-4710-be56-2b9369c7a159 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e.info" returned: 0 in 0.283s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:07 devstack cinder-volume[86980]: WARNING cinder.volume.drivers.remotefs [None req-96f7c4f1-dca8-4710-be56-2b9369c7a159 tempest-ProjectReaderTests-1876210163 None] /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e.info is being set with open permissions: ugo+rw Sep 28 18:31:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-96f7c4f1-dca8-4710-be56-2b9369c7a159 tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e.info {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:07 devstack sudo[109275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e.info Sep 28 18:31:07 devstack sudo[109275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:07 devstack sudo[109275]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-96f7c4f1-dca8-4710-be56-2b9369c7a159 tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e.info" returned: 0 in 0.261s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:07 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-96f7c4f1-dca8-4710-be56-2b9369c7a159 tempest-ProjectReaderTests-1876210163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.170s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:07 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-96f7c4f1-dca8-4710-be56-2b9369c7a159 tempest-ProjectReaderTests-1876210163 None] Create snapshot completed successfully Sep 28 18:31:08 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b7408044-01b9-4a7b-9c5f-34794815165e tempest-ProjectReaderTests-1876210163 None] Acquiring lock "cinder-bdc47416-4891-40f0-a2a5-e868c89009db-delete_snapshot" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:08 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b7408044-01b9-4a7b-9c5f-34794815165e tempest-ProjectReaderTests-1876210163 None] Lock "cinder-bdc47416-4891-40f0-a2a5-e868c89009db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:08 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b7408044-01b9-4a7b-9c5f-34794815165e tempest-ProjectReaderTests-1876210163 None] Acquiring lock "cinder-quobyte-32296024-8c26-4810-b5ba-bc5b63bf069e" by "delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:08 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b7408044-01b9-4a7b-9c5f-34794815165e tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-32296024-8c26-4810-b5ba-bc5b63bf069e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:08 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b7408044-01b9-4a7b-9c5f-34794815165e tempest-ProjectReaderTests-1876210163 None] Acquiring lock "cinder-quobyte-bdc47416-4891-40f0-a2a5-e868c89009db" by "_delete_snapshot" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:08 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b7408044-01b9-4a7b-9c5f-34794815165e tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-bdc47416-4891-40f0-a2a5-e868c89009db" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:08 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-b7408044-01b9-4a7b-9c5f-34794815165e tempest-ProjectReaderTests-1876210163 None] Deleting offline snapshot bdc47416-4891-40f0-a2a5-e868c89009db of volume 32296024-8c26-4810-b5ba-bc5b63bf069e {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 18:31:08 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-b7408044-01b9-4a7b-9c5f-34794815165e tempest-ProjectReaderTests-1876210163 None] snapshot_file for this snap is: volume-32296024-8c26-4810-b5ba-bc5b63bf069e.bdc47416-4891-40f0-a2a5-e868c89009db {{(pid=86980) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 18:31:08 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcd2b02-1f33-472b-a600-4ffcc7a9dbc2]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:08 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b7408044-01b9-4a7b-9c5f-34794815165e tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e.bdc47416-4891-40f0-a2a5-e868c89009db {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:08 devstack sudo[109279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e.bdc47416-4891-40f0-a2a5-e868c89009db Sep 28 18:31:08 devstack sudo[109279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:08 devstack sudo[109279]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b7408044-01b9-4a7b-9c5f-34794815165e tempest-ProjectReaderTests-1876210163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e.bdc47416-4891-40f0-a2a5-e868c89009db" returned: 0 in 0.406s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:09 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-b7408044-01b9-4a7b-9c5f-34794815165e tempest-ProjectReaderTests-1876210163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32296024-8c26-4810-b5ba-bc5b63bf069e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86980) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 18:31:09 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[526c82f5-6567-4d4b-ac6c-c444f0afd807]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b7408044-01b9-4a7b-9c5f-34794815165e tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:09 devstack sudo[109284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e Sep 28 18:31:09 devstack sudo[109284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:09 devstack sudo[109284]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b7408044-01b9-4a7b-9c5f-34794815165e tempest-ProjectReaderTests-1876210163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e" returned: 0 in 0.526s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b7408044-01b9-4a7b-9c5f-34794815165e tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e.bdc47416-4891-40f0-a2a5-e868c89009db {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:09 devstack sudo[109289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e.bdc47416-4891-40f0-a2a5-e868c89009db Sep 28 18:31:09 devstack sudo[109289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:09 devstack sudo[109289]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b7408044-01b9-4a7b-9c5f-34794815165e tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e.bdc47416-4891-40f0-a2a5-e868c89009db" returned: 0 in 0.381s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:09 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b7408044-01b9-4a7b-9c5f-34794815165e tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e.bdc47416-4891-40f0-a2a5-e868c89009db {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:09 devstack sudo[109296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e.bdc47416-4891-40f0-a2a5-e868c89009db Sep 28 18:31:09 devstack sudo[109296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:10 devstack sudo[109296]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-b7408044-01b9-4a7b-9c5f-34794815165e tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e.bdc47416-4891-40f0-a2a5-e868c89009db" returned: 0 in 0.297s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:10 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b7408044-01b9-4a7b-9c5f-34794815165e tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-bdc47416-4891-40f0-a2a5-e868c89009db" released by "_delete_snapshot" :: held 1.719s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:10 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b7408044-01b9-4a7b-9c5f-34794815165e tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-32296024-8c26-4810-b5ba-bc5b63bf069e" released by "delete_snapshot" :: held 1.744s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:10 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-b7408044-01b9-4a7b-9c5f-34794815165e tempest-ProjectReaderTests-1876210163 None] Created reservations ['cb0c22bf-5ff5-493b-90a9-b8fc8555c33c', 'bfb211cd-e32a-487e-88fe-6e32d9e35a34', 'd37a26f8-f4e1-40a2-b32b-f05939498f8e', 'd5f6ccee-f8c8-4783-af37-e52da417e419'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:10 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-b7408044-01b9-4a7b-9c5f-34794815165e tempest-ProjectReaderTests-1876210163 None] Delete snapshot completed successfully. Sep 28 18:31:10 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-b7408044-01b9-4a7b-9c5f-34794815165e tempest-ProjectReaderTests-1876210163 None] Lock "cinder-bdc47416-4891-40f0-a2a5-e868c89009db-delete_snapshot" released by "delete_snapshot" :: held 1.906s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:10 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6f6fef94-46dd-49af-b4ae-756b914f799d tempest-ProjectReaderTests-1876210163 None] Acquiring lock "cinder-32296024-8c26-4810-b5ba-bc5b63bf069e-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:10 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6f6fef94-46dd-49af-b4ae-756b914f799d tempest-ProjectReaderTests-1876210163 None] Lock "cinder-32296024-8c26-4810-b5ba-bc5b63bf069e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:10 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6f6fef94-46dd-49af-b4ae-756b914f799d tempest-ProjectReaderTests-1876210163 None] Acquiring lock "cinder-quobyte-32296024-8c26-4810-b5ba-bc5b63bf069e" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:10 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6f6fef94-46dd-49af-b4ae-756b914f799d tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-32296024-8c26-4810-b5ba-bc5b63bf069e" acquired by "delete_volume" :: waited 0.013s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:10 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[b137f3f8-e833-4cff-ae7d-a8df3a311940]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:10 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6f6fef94-46dd-49af-b4ae-756b914f799d tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:10 devstack sudo[109299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e Sep 28 18:31:10 devstack sudo[109299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:11 devstack sudo[109299]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6f6fef94-46dd-49af-b4ae-756b914f799d tempest-ProjectReaderTests-1876210163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e" returned: 0 in 0.407s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6f6fef94-46dd-49af-b4ae-756b914f799d tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:11 devstack sudo[109304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e Sep 28 18:31:11 devstack sudo[109304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:11 devstack sudo[109304]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6f6fef94-46dd-49af-b4ae-756b914f799d tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-32296024-8c26-4810-b5ba-bc5b63bf069e" returned: 0 in 0.282s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:11 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6f6fef94-46dd-49af-b4ae-756b914f799d tempest-ProjectReaderTests-1876210163 None] Lock "cinder-quobyte-32296024-8c26-4810-b5ba-bc5b63bf069e" released by "delete_volume" :: held 0.756s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:11 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-6f6fef94-46dd-49af-b4ae-756b914f799d tempest-ProjectReaderTests-1876210163 None] Created reservations ['232f2324-8481-4c57-bb8f-9ca410b595a9', 'e20f5fb2-65d3-4a4f-bd7f-832ef29721ed', '38a80665-a048-4b9f-9e15-fcbaf3cc32c1', '7bf0b984-1729-40f7-b3a2-054ec2f4de66'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6f6fef94-46dd-49af-b4ae-756b914f799d tempest-ProjectReaderTests-1876210163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6f6fef94-46dd-49af-b4ae-756b914f799d tempest-ProjectReaderTests-1876210163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:11 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6f6fef94-46dd-49af-b4ae-756b914f799d tempest-ProjectReaderTests-1876210163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:11 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6f6fef94-46dd-49af-b4ae-756b914f799d tempest-ProjectReaderTests-1876210163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6f6fef94-46dd-49af-b4ae-756b914f799d tempest-ProjectReaderTests-1876210163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6f6fef94-46dd-49af-b4ae-756b914f799d tempest-ProjectReaderTests-1876210163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:11 devstack sudo[109307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:31:11 devstack sudo[109307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:11 devstack sudo[109307]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:11 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6f6fef94-46dd-49af-b4ae-756b914f799d tempest-ProjectReaderTests-1876210163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.295s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:11 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6f6fef94-46dd-49af-b4ae-756b914f799d tempest-ProjectReaderTests-1876210163 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:31:11 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-6f6fef94-46dd-49af-b4ae-756b914f799d tempest-ProjectReaderTests-1876210163 None] Deleted volume successfully. Sep 28 18:31:11 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-6f6fef94-46dd-49af-b4ae-756b914f799d tempest-ProjectReaderTests-1876210163 None] Lock "cinder-32296024-8c26-4810-b5ba-bc5b63bf069e-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:21 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:31:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Flow 'volume_create_manager' (6eff05ef-6d01-4170-8e09-6330fc1b8666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e154e15-eda0-4142-bbeb-77bdfde24544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e154e15-eda0-4142-bbeb-77bdfde24544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1262108852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdb52f6e-b2f2-4eef-b330-c6a92d2ff1a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94dcc3d878914dac90e983dcf6949be6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:21Z,use_quota=True,user_id='a490fe74bcef4cdf831be220d4943d74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e0e031-7568-4ac8-9a29-b1fae8da9586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e0e031-7568-4ac8-9a29-b1fae8da9586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a23452ff-492c-4c80-8285-081c53d9d3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a23452ff-492c-4c80-8285-081c53d9d3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdb52f6e-b2f2-4eef-b330-c6a92d2ff1a0', 'volume_name': 'volume-fdb52f6e-b2f2-4eef-b330-c6a92d2ff1a0', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d691d8a-bca8-4c78-b9b4-97b030d5cc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d691d8a-bca8-4c78-b9b4-97b030d5cc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:21 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ec93db-df12-4700-af8a-a2982d980116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:21 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Volume fdb52f6e-b2f2-4eef-b330-c6a92d2ff1a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdb52f6e-b2f2-4eef-b330-c6a92d2ff1a0', 'volume_size': 1} Sep 28 18:31:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:21 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1262108852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdb52f6e-b2f2-4eef-b330-c6a92d2ff1a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94dcc3d878914dac90e983dcf6949be6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:21Z,use_quota=True,user_id='a490fe74bcef4cdf831be220d4943d74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:31:21 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Creating volume fdb52f6e-b2f2-4eef-b330-c6a92d2ff1a0 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:31:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:21 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:21 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:21 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:31:21 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:31:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fdb52f6e-b2f2-4eef-b330-c6a92d2ff1a0 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:21 devstack sudo[109312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fdb52f6e-b2f2-4eef-b330-c6a92d2ff1a0 1073741824 Sep 28 18:31:21 devstack sudo[109312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:21 devstack sudo[109312]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fdb52f6e-b2f2-4eef-b330-c6a92d2ff1a0 1073741824" returned: 0 in 0.469s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:21 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fdb52f6e-b2f2-4eef-b330-c6a92d2ff1a0 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:21 devstack sudo[109318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fdb52f6e-b2f2-4eef-b330-c6a92d2ff1a0 Sep 28 18:31:21 devstack sudo[109318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:22 devstack sudo[109318]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fdb52f6e-b2f2-4eef-b330-c6a92d2ff1a0" returned: 0 in 0.317s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:22 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:31:22 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ec93db-df12-4700-af8a-a2982d980116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdb52f6e-b2f2-4eef-b330-c6a92d2ff1a0', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c8f651f-4070-44d4-bbcf-f9f301f03b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:22 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Volume volume-fdb52f6e-b2f2-4eef-b330-c6a92d2ff1a0 (fdb52f6e-b2f2-4eef-b330-c6a92d2ff1a0): created successfully Sep 28 18:31:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c8f651f-4070-44d4-bbcf-f9f301f03b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:22 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Flow 'volume_create_manager' (6eff05ef-6d01-4170-8e09-6330fc1b8666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:22 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-3186d1af-46d3-4fbc-8876-1b37cbaec794 tempest-ProjectReaderTests-792343778 None] Created volume successfully. Sep 28 18:31:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-56414b6f-13d2-4b0c-8228-b77e9bd22f07 tempest-ProjectReaderTests-792343778 None] Acquiring lock "cinder-fdb52f6e-b2f2-4eef-b330-c6a92d2ff1a0-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-56414b6f-13d2-4b0c-8228-b77e9bd22f07 tempest-ProjectReaderTests-792343778 None] Lock "cinder-fdb52f6e-b2f2-4eef-b330-c6a92d2ff1a0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:23 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=75,cinder:UPDATE=96,cinder:DELETE=6,cinder:INSERT=28 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:31:23 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:UPDATE=90,cinder:SELECT=69,cinder:INSERT=23,cinder:DELETE=10 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:31:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-56414b6f-13d2-4b0c-8228-b77e9bd22f07 tempest-ProjectReaderTests-792343778 None] Acquiring lock "cinder-quobyte-fdb52f6e-b2f2-4eef-b330-c6a92d2ff1a0" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:23 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-56414b6f-13d2-4b0c-8228-b77e9bd22f07 tempest-ProjectReaderTests-792343778 None] Lock "cinder-quobyte-fdb52f6e-b2f2-4eef-b330-c6a92d2ff1a0" acquired by "delete_volume" :: waited 0.021s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:23 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad97b757-dc3b-4655-a454-43d7dd7e37e6]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:23 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-56414b6f-13d2-4b0c-8228-b77e9bd22f07 tempest-ProjectReaderTests-792343778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fdb52f6e-b2f2-4eef-b330-c6a92d2ff1a0 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:23 devstack sudo[109321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fdb52f6e-b2f2-4eef-b330-c6a92d2ff1a0 Sep 28 18:31:23 devstack sudo[109321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:24 devstack sudo[109321]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-56414b6f-13d2-4b0c-8228-b77e9bd22f07 tempest-ProjectReaderTests-792343778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fdb52f6e-b2f2-4eef-b330-c6a92d2ff1a0" returned: 0 in 0.408s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-56414b6f-13d2-4b0c-8228-b77e9bd22f07 tempest-ProjectReaderTests-792343778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fdb52f6e-b2f2-4eef-b330-c6a92d2ff1a0 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:24 devstack sudo[109326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fdb52f6e-b2f2-4eef-b330-c6a92d2ff1a0 Sep 28 18:31:24 devstack sudo[109326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:24 devstack sudo[109326]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-56414b6f-13d2-4b0c-8228-b77e9bd22f07 tempest-ProjectReaderTests-792343778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-fdb52f6e-b2f2-4eef-b330-c6a92d2ff1a0" returned: 0 in 0.261s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:24 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-56414b6f-13d2-4b0c-8228-b77e9bd22f07 tempest-ProjectReaderTests-792343778 None] Lock "cinder-quobyte-fdb52f6e-b2f2-4eef-b330-c6a92d2ff1a0" released by "delete_volume" :: held 0.717s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:24 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-56414b6f-13d2-4b0c-8228-b77e9bd22f07 tempest-ProjectReaderTests-792343778 None] Created reservations ['4bdb94fd-6caf-496b-9311-6edf19e16408', '02760920-5098-4b20-8aaf-f9c35f4d3458', 'b48e3cd1-520c-4a29-8c75-c942e0e69495', '856f0ccc-3174-40e1-bd42-158efd8ae780'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-56414b6f-13d2-4b0c-8228-b77e9bd22f07 tempest-ProjectReaderTests-792343778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-56414b6f-13d2-4b0c-8228-b77e9bd22f07 tempest-ProjectReaderTests-792343778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:24 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-56414b6f-13d2-4b0c-8228-b77e9bd22f07 tempest-ProjectReaderTests-792343778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:24 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-56414b6f-13d2-4b0c-8228-b77e9bd22f07 tempest-ProjectReaderTests-792343778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-56414b6f-13d2-4b0c-8228-b77e9bd22f07 tempest-ProjectReaderTests-792343778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-56414b6f-13d2-4b0c-8228-b77e9bd22f07 tempest-ProjectReaderTests-792343778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:24 devstack sudo[109329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:31:24 devstack sudo[109329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:24 devstack sudo[109329]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:24 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-56414b6f-13d2-4b0c-8228-b77e9bd22f07 tempest-ProjectReaderTests-792343778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.278s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:24 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-56414b6f-13d2-4b0c-8228-b77e9bd22f07 tempest-ProjectReaderTests-792343778 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:31:24 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-56414b6f-13d2-4b0c-8228-b77e9bd22f07 tempest-ProjectReaderTests-792343778 None] Deleted volume successfully. Sep 28 18:31:24 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-56414b6f-13d2-4b0c-8228-b77e9bd22f07 tempest-ProjectReaderTests-792343778 None] Lock "cinder-fdb52f6e-b2f2-4eef-b330-c6a92d2ff1a0-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:25 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:31:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Flow 'volume_create_manager' (9199c33e-fb1b-44ed-b632-da4a6cc5ede8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9305f638-84bf-4db5-abb9-920721d6eb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9305f638-84bf-4db5-abb9-920721d6eb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2124788324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8443d9ed-caf9-4583-8b8e-e97d6e2f8a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94dcc3d878914dac90e983dcf6949be6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:25Z,use_quota=True,user_id='a490fe74bcef4cdf831be220d4943d74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (027573ff-3ab5-490b-9a8c-1a7d330f35e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (027573ff-3ab5-490b-9a8c-1a7d330f35e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4700594-350e-4514-a387-ec9926aaefb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4700594-350e-4514-a387-ec9926aaefb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8443d9ed-caf9-4583-8b8e-e97d6e2f8a16', 'volume_name': 'volume-8443d9ed-caf9-4583-8b8e-e97d6e2f8a16', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f54c16f-f8e2-476d-9426-3da62cd94ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f54c16f-f8e2-476d-9426-3da62cd94ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:25 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea87562-c6c2-41c7-83c9-7ff80aa71bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:25 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Volume 8443d9ed-caf9-4583-8b8e-e97d6e2f8a16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8443d9ed-caf9-4583-8b8e-e97d6e2f8a16', 'volume_size': 1} Sep 28 18:31:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:25 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2124788324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8443d9ed-caf9-4583-8b8e-e97d6e2f8a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94dcc3d878914dac90e983dcf6949be6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:25Z,use_quota=True,user_id='a490fe74bcef4cdf831be220d4943d74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:31:25 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Creating volume 8443d9ed-caf9-4583-8b8e-e97d6e2f8a16 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:31:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:25 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:25 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:25 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:31:25 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:31:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8443d9ed-caf9-4583-8b8e-e97d6e2f8a16 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:25 devstack sudo[109332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8443d9ed-caf9-4583-8b8e-e97d6e2f8a16 1073741824 Sep 28 18:31:25 devstack sudo[109332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:25 devstack sudo[109332]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8443d9ed-caf9-4583-8b8e-e97d6e2f8a16 1073741824" returned: 0 in 0.445s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:25 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8443d9ed-caf9-4583-8b8e-e97d6e2f8a16 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:25 devstack sudo[109337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8443d9ed-caf9-4583-8b8e-e97d6e2f8a16 Sep 28 18:31:25 devstack sudo[109337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:26 devstack sudo[109337]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8443d9ed-caf9-4583-8b8e-e97d6e2f8a16" returned: 0 in 0.242s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:26 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:31:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:26 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea87562-c6c2-41c7-83c9-7ff80aa71bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8443d9ed-caf9-4583-8b8e-e97d6e2f8a16', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:26 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b89fc55-f402-4e31-b6ab-493c7ee9d4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:26 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Volume volume-8443d9ed-caf9-4583-8b8e-e97d6e2f8a16 (8443d9ed-caf9-4583-8b8e-e97d6e2f8a16): created successfully Sep 28 18:31:26 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b89fc55-f402-4e31-b6ab-493c7ee9d4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:26 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Flow 'volume_create_manager' (9199c33e-fb1b-44ed-b632-da4a6cc5ede8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:26 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-d78ec20d-8e43-4a12-a463-5c16cc031570 tempest-ProjectReaderTests-792343778 None] Created volume successfully. Sep 28 18:31:26 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-2712dbea-b03c-4f03-9a5a-6403664aaec4 tempest-ProjectReaderTests-792343778 None] Acquiring lock "cinder-8443d9ed-caf9-4583-8b8e-e97d6e2f8a16-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:26 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-2712dbea-b03c-4f03-9a5a-6403664aaec4 tempest-ProjectReaderTests-792343778 None] Lock "cinder-8443d9ed-caf9-4583-8b8e-e97d6e2f8a16-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:26 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-2712dbea-b03c-4f03-9a5a-6403664aaec4 tempest-ProjectReaderTests-792343778 None] Acquiring lock "cinder-quobyte-8443d9ed-caf9-4583-8b8e-e97d6e2f8a16" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:26 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-2712dbea-b03c-4f03-9a5a-6403664aaec4 tempest-ProjectReaderTests-792343778 None] Lock "cinder-quobyte-8443d9ed-caf9-4583-8b8e-e97d6e2f8a16" acquired by "delete_volume" :: waited 0.015s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:26 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa49dc0-0cc3-4819-a9bb-168345f56376]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2712dbea-b03c-4f03-9a5a-6403664aaec4 tempest-ProjectReaderTests-792343778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8443d9ed-caf9-4583-8b8e-e97d6e2f8a16 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:26 devstack sudo[109340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8443d9ed-caf9-4583-8b8e-e97d6e2f8a16 Sep 28 18:31:26 devstack sudo[109340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:26 devstack sudo[109340]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2712dbea-b03c-4f03-9a5a-6403664aaec4 tempest-ProjectReaderTests-792343778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8443d9ed-caf9-4583-8b8e-e97d6e2f8a16" returned: 0 in 0.398s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:26 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2712dbea-b03c-4f03-9a5a-6403664aaec4 tempest-ProjectReaderTests-792343778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8443d9ed-caf9-4583-8b8e-e97d6e2f8a16 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:26 devstack sudo[109345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8443d9ed-caf9-4583-8b8e-e97d6e2f8a16 Sep 28 18:31:26 devstack sudo[109345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:27 devstack sudo[109345]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2712dbea-b03c-4f03-9a5a-6403664aaec4 tempest-ProjectReaderTests-792343778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-8443d9ed-caf9-4583-8b8e-e97d6e2f8a16" returned: 0 in 0.294s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:27 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-2712dbea-b03c-4f03-9a5a-6403664aaec4 tempest-ProjectReaderTests-792343778 None] Lock "cinder-quobyte-8443d9ed-caf9-4583-8b8e-e97d6e2f8a16" released by "delete_volume" :: held 0.749s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:27 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-2712dbea-b03c-4f03-9a5a-6403664aaec4 tempest-ProjectReaderTests-792343778 None] Created reservations ['8505c999-f1a1-4bd6-9759-3148c209a6c8', 'a97b5c8b-50bc-46e0-a5aa-6fc34564d709', '5663c1ee-d191-4f6a-8c83-e0d3b5ed0fae', 'e7f3ae17-f6e7-476f-af4c-ad4505e4b61a'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2712dbea-b03c-4f03-9a5a-6403664aaec4 tempest-ProjectReaderTests-792343778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2712dbea-b03c-4f03-9a5a-6403664aaec4 tempest-ProjectReaderTests-792343778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2712dbea-b03c-4f03-9a5a-6403664aaec4 tempest-ProjectReaderTests-792343778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:27 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-2712dbea-b03c-4f03-9a5a-6403664aaec4 tempest-ProjectReaderTests-792343778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-2712dbea-b03c-4f03-9a5a-6403664aaec4 tempest-ProjectReaderTests-792343778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2712dbea-b03c-4f03-9a5a-6403664aaec4 tempest-ProjectReaderTests-792343778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:27 devstack sudo[109348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:31:27 devstack sudo[109348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:27 devstack sudo[109348]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:27 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-2712dbea-b03c-4f03-9a5a-6403664aaec4 tempest-ProjectReaderTests-792343778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.305s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:27 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-2712dbea-b03c-4f03-9a5a-6403664aaec4 tempest-ProjectReaderTests-792343778 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:31:27 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-2712dbea-b03c-4f03-9a5a-6403664aaec4 tempest-ProjectReaderTests-792343778 None] Deleted volume successfully. Sep 28 18:31:27 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-2712dbea-b03c-4f03-9a5a-6403664aaec4 tempest-ProjectReaderTests-792343778 None] Lock "cinder-8443d9ed-caf9-4583-8b8e-e97d6e2f8a16-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:27 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Flow 'volume_create_manager' (a8308085-7b17-4f75-ba00-e09ed94ec23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7700f37-51e1-4d25-9895-24cfd7c0a9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7700f37-51e1-4d25-9895-24cfd7c0a9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1964657563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4eceb9-d823-40f6-8e5b-0966b36dffb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94dcc3d878914dac90e983dcf6949be6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:28Z,use_quota=True,user_id='a490fe74bcef4cdf831be220d4943d74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06faf633-a9a1-45ee-b87d-849843747239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06faf633-a9a1-45ee-b87d-849843747239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b972bd8-09b5-478c-a7fb-e28bbad41925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b972bd8-09b5-478c-a7fb-e28bbad41925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa4eceb9-d823-40f6-8e5b-0966b36dffb8', 'volume_name': 'volume-aa4eceb9-d823-40f6-8e5b-0966b36dffb8', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e191fc-269d-4356-ba4a-0a371236a17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e191fc-269d-4356-ba4a-0a371236a17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db679d8-1ac1-454c-9a42-5207732ba7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:28 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Volume aa4eceb9-d823-40f6-8e5b-0966b36dffb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa4eceb9-d823-40f6-8e5b-0966b36dffb8', 'volume_size': 1} Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1964657563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4eceb9-d823-40f6-8e5b-0966b36dffb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94dcc3d878914dac90e983dcf6949be6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:28Z,use_quota=True,user_id='a490fe74bcef4cdf831be220d4943d74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Creating volume aa4eceb9-d823-40f6-8e5b-0966b36dffb8 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:31:28 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-aa4eceb9-d823-40f6-8e5b-0966b36dffb8 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:28 devstack sudo[109351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-aa4eceb9-d823-40f6-8e5b-0966b36dffb8 1073741824 Sep 28 18:31:28 devstack sudo[109351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:28 devstack sudo[109351]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-aa4eceb9-d823-40f6-8e5b-0966b36dffb8 1073741824" returned: 0 in 0.464s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-aa4eceb9-d823-40f6-8e5b-0966b36dffb8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:28 devstack sudo[109356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-aa4eceb9-d823-40f6-8e5b-0966b36dffb8 Sep 28 18:31:28 devstack sudo[109356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:28 devstack sudo[109356]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-aa4eceb9-d823-40f6-8e5b-0966b36dffb8" returned: 0 in 0.264s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db679d8-1ac1-454c-9a42-5207732ba7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa4eceb9-d823-40f6-8e5b-0966b36dffb8', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c27f9193-eca5-44a2-b01c-33d70382a19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:28 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Volume volume-aa4eceb9-d823-40f6-8e5b-0966b36dffb8 (aa4eceb9-d823-40f6-8e5b-0966b36dffb8): created successfully Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c27f9193-eca5-44a2-b01c-33d70382a19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:28 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Flow 'volume_create_manager' (a8308085-7b17-4f75-ba00-e09ed94ec23e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:28 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-290a5157-f9ab-48e5-99da-7474bc7a4f06 tempest-ProjectReaderTests-792343778 None] Created volume successfully. Sep 28 18:31:29 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-58cf6ee3-f0b8-4638-8d72-407fb19fb8f1 tempest-ProjectReaderTests-792343778 None] Acquiring lock "cinder-aa4eceb9-d823-40f6-8e5b-0966b36dffb8-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:29 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-58cf6ee3-f0b8-4638-8d72-407fb19fb8f1 tempest-ProjectReaderTests-792343778 None] Lock "cinder-aa4eceb9-d823-40f6-8e5b-0966b36dffb8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:29 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-58cf6ee3-f0b8-4638-8d72-407fb19fb8f1 tempest-ProjectReaderTests-792343778 None] Acquiring lock "cinder-quobyte-aa4eceb9-d823-40f6-8e5b-0966b36dffb8" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:29 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-58cf6ee3-f0b8-4638-8d72-407fb19fb8f1 tempest-ProjectReaderTests-792343778 None] Lock "cinder-quobyte-aa4eceb9-d823-40f6-8e5b-0966b36dffb8" acquired by "delete_volume" :: waited 0.017s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:29 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc6d529-ce31-49f8-83a7-c5552ccf75df]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-58cf6ee3-f0b8-4638-8d72-407fb19fb8f1 tempest-ProjectReaderTests-792343778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-aa4eceb9-d823-40f6-8e5b-0966b36dffb8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:29 devstack sudo[109359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-aa4eceb9-d823-40f6-8e5b-0966b36dffb8 Sep 28 18:31:29 devstack sudo[109359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:29 devstack sudo[109359]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-58cf6ee3-f0b8-4638-8d72-407fb19fb8f1 tempest-ProjectReaderTests-792343778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-aa4eceb9-d823-40f6-8e5b-0966b36dffb8" returned: 0 in 0.397s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-58cf6ee3-f0b8-4638-8d72-407fb19fb8f1 tempest-ProjectReaderTests-792343778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-aa4eceb9-d823-40f6-8e5b-0966b36dffb8 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:29 devstack sudo[109365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-aa4eceb9-d823-40f6-8e5b-0966b36dffb8 Sep 28 18:31:29 devstack sudo[109365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:29 devstack sudo[109365]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:29 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-58cf6ee3-f0b8-4638-8d72-407fb19fb8f1 tempest-ProjectReaderTests-792343778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-aa4eceb9-d823-40f6-8e5b-0966b36dffb8" returned: 0 in 0.266s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:29 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-58cf6ee3-f0b8-4638-8d72-407fb19fb8f1 tempest-ProjectReaderTests-792343778 None] Lock "cinder-quobyte-aa4eceb9-d823-40f6-8e5b-0966b36dffb8" released by "delete_volume" :: held 0.706s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:29 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-58cf6ee3-f0b8-4638-8d72-407fb19fb8f1 tempest-ProjectReaderTests-792343778 None] Created reservations ['a772fda9-42c2-48ed-a80e-674d2d9ab875', 'afb72c98-6219-4351-86a7-4692adf61b42', 'f00da806-b2cf-499f-ab61-10d37c47bd15', '0728b862-370d-4388-8f75-5a10d2e36871'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-58cf6ee3-f0b8-4638-8d72-407fb19fb8f1 tempest-ProjectReaderTests-792343778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-58cf6ee3-f0b8-4638-8d72-407fb19fb8f1 tempest-ProjectReaderTests-792343778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-58cf6ee3-f0b8-4638-8d72-407fb19fb8f1 tempest-ProjectReaderTests-792343778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-58cf6ee3-f0b8-4638-8d72-407fb19fb8f1 tempest-ProjectReaderTests-792343778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-58cf6ee3-f0b8-4638-8d72-407fb19fb8f1 tempest-ProjectReaderTests-792343778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-58cf6ee3-f0b8-4638-8d72-407fb19fb8f1 tempest-ProjectReaderTests-792343778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:30 devstack sudo[109368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:31:30 devstack sudo[109368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:30 devstack sudo[109368]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-58cf6ee3-f0b8-4638-8d72-407fb19fb8f1 tempest-ProjectReaderTests-792343778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.281s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-58cf6ee3-f0b8-4638-8d72-407fb19fb8f1 tempest-ProjectReaderTests-792343778 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:31:30 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-58cf6ee3-f0b8-4638-8d72-407fb19fb8f1 tempest-ProjectReaderTests-792343778 None] Deleted volume successfully. Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-58cf6ee3-f0b8-4638-8d72-407fb19fb8f1 tempest-ProjectReaderTests-792343778 None] Lock "cinder-aa4eceb9-d823-40f6-8e5b-0966b36dffb8-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86980) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Flow 'volume_create_manager' (718b05de-3b3d-4bdd-8211-c2987943b28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24370f3e-9262-46f2-ae4b-1a71231e4bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24370f3e-9262-46f2-ae4b-1a71231e4bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1836373752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b703585-a14d-485c-b448-449b72415668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94dcc3d878914dac90e983dcf6949be6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:31Z,use_quota=True,user_id='a490fe74bcef4cdf831be220d4943d74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c710739d-53b6-4f7b-be43-c607cbad6f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c710739d-53b6-4f7b-be43-c607cbad6f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e08e3d7-7235-41ae-bef5-f9e6b43e87e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e08e3d7-7235-41ae-bef5-f9e6b43e87e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b703585-a14d-485c-b448-449b72415668', 'volume_name': 'volume-4b703585-a14d-485c-b448-449b72415668', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f56fb3-ce4a-4a19-81c3-ed646da4d666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f56fb3-ce4a-4a19-81c3-ed646da4d666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (716dfb1f-e562-422e-a4c1-f25969de9b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:30 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Volume 4b703585-a14d-485c-b448-449b72415668: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b703585-a14d-485c-b448-449b72415668', 'volume_size': 1} Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T16:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1836373752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b703585-a14d-485c-b448-449b72415668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94dcc3d878914dac90e983dcf6949be6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T16:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T16:31:31Z,use_quota=True,user_id='a490fe74bcef4cdf831be220d4943d74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba47d8c2-dbc9-48c2-b264-f44a7da7db66),volume_type_id=ba47d8c2-dbc9-48c2-b264-f44a7da7db66)}" {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.remotefs [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Creating volume 4b703585-a14d-485c-b448-449b72415668 {{(pid=86980) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Selected osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 as target Quobyte volume. {{(pid=86980) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 18:31:30 devstack cinder-volume[86980]: INFO cinder.volume.drivers.remotefs [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] casted to osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729 Sep 28 18:31:30 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b703585-a14d-485c-b448-449b72415668 1073741824 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:30 devstack sudo[109371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b703585-a14d-485c-b448-449b72415668 1073741824 Sep 28 18:31:30 devstack sudo[109371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:31 devstack sudo[109371]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b703585-a14d-485c-b448-449b72415668 1073741824" returned: 0 in 0.465s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b703585-a14d-485c-b448-449b72415668 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:31 devstack sudo[109377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b703585-a14d-485c-b448-449b72415668 Sep 28 18:31:31 devstack sudo[109377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:31 devstack sudo[109377]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b703585-a14d-485c-b448-449b72415668" returned: 0 in 0.303s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:31 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'} {{(pid=86980) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 18:31:31 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (716dfb1f-e562-422e-a4c1-f25969de9b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b703585-a14d-485c-b448-449b72415668', 'volume_size': 1}' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cddd6335-ce42-4c12-9944-126df47d44be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 18:31:31 devstack cinder-volume[86980]: INFO cinder.volume.flows.manager.create_volume [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Volume volume-4b703585-a14d-485c-b448-449b72415668 (4b703585-a14d-485c-b448-449b72415668): created successfully Sep 28 18:31:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cddd6335-ce42-4c12-9944-126df47d44be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86980) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 18:31:31 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Flow 'volume_create_manager' (718b05de-3b3d-4bdd-8211-c2987943b28e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86980) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 18:31:31 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-e2d2e0aa-4740-4b83-9f1a-9a86ca1e43f2 tempest-ProjectReaderTests-792343778 None] Created volume successfully. Sep 28 18:31:32 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bb8a73f5-a890-4868-9119-eb7c858bb514 tempest-ProjectReaderTests-792343778 None] Acquiring lock "cinder-4b703585-a14d-485c-b448-449b72415668-delete_volume" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:33 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bb8a73f5-a890-4868-9119-eb7c858bb514 tempest-ProjectReaderTests-792343778 None] Lock "cinder-4b703585-a14d-485c-b448-449b72415668-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:33 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bb8a73f5-a890-4868-9119-eb7c858bb514 tempest-ProjectReaderTests-792343778 None] Acquiring lock "cinder-quobyte-4b703585-a14d-485c-b448-449b72415668" by "delete_volume" {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 18:31:33 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bb8a73f5-a890-4868-9119-eb7c858bb514 tempest-ProjectReaderTests-792343778 None] Lock "cinder-quobyte-4b703585-a14d-485c-b448-449b72415668" acquired by "delete_volume" :: waited 0.018s {{(pid=86980) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 18:31:33 devstack cinder-volume[86980]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7a722b-be50-4b88-b804-2cd2d55e89a8]: (4, 'qcow2') {{(pid=88615) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 18:31:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bb8a73f5-a890-4868-9119-eb7c858bb514 tempest-ProjectReaderTests-792343778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b703585-a14d-485c-b448-449b72415668 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:33 devstack sudo[109381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b703585-a14d-485c-b448-449b72415668 Sep 28 18:31:33 devstack sudo[109381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:33 devstack sudo[109381]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bb8a73f5-a890-4868-9119-eb7c858bb514 tempest-ProjectReaderTests-792343778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b703585-a14d-485c-b448-449b72415668" returned: 0 in 0.421s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bb8a73f5-a890-4868-9119-eb7c858bb514 tempest-ProjectReaderTests-792343778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b703585-a14d-485c-b448-449b72415668 {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:33 devstack sudo[109386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b703585-a14d-485c-b448-449b72415668 Sep 28 18:31:33 devstack sudo[109386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:33 devstack sudo[109386]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bb8a73f5-a890-4868-9119-eb7c858bb514 tempest-ProjectReaderTests-792343778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a/volume-4b703585-a14d-485c-b448-449b72415668" returned: 0 in 0.285s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:33 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bb8a73f5-a890-4868-9119-eb7c858bb514 tempest-ProjectReaderTests-792343778 None] Lock "cinder-quobyte-4b703585-a14d-485c-b448-449b72415668" released by "delete_volume" :: held 0.756s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:33 devstack cinder-volume[86980]: DEBUG cinder.quota [None req-bb8a73f5-a890-4868-9119-eb7c858bb514 tempest-ProjectReaderTests-792343778 None] Created reservations ['7cb5c130-8325-4aa8-ac18-460eb34416be', '8d7caeb9-4c86-4e07-8de3-8a875d2ca4b8', 'bfb5ae24-ecd4-4f0f-81ec-61ec5a59c612', 'b79f81d9-0b46-4054-9877-418f38239508'] {{(pid=86980) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 18:31:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bb8a73f5-a890-4868-9119-eb7c858bb514 tempest-ProjectReaderTests-792343778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:31:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bb8a73f5-a890-4868-9119-eb7c858bb514 tempest-ProjectReaderTests-792343778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:31:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-bb8a73f5-a890-4868-9119-eb7c858bb514 tempest-ProjectReaderTests-792343778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:31:33 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-bb8a73f5-a890-4868-9119-eb7c858bb514 tempest-ProjectReaderTests-792343778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:31:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-bb8a73f5-a890-4868-9119-eb7c858bb514 tempest-ProjectReaderTests-792343778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:31:33 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bb8a73f5-a890-4868-9119-eb7c858bb514 tempest-ProjectReaderTests-792343778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:31:34 devstack sudo[109389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:31:34 devstack sudo[109389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:31:34 devstack sudo[109389]: pam_unix(sudo:session): session closed for user root Sep 28 18:31:34 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-bb8a73f5-a890-4868-9119-eb7c858bb514 tempest-ProjectReaderTests-792343778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.285s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:31:34 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-bb8a73f5-a890-4868-9119-eb7c858bb514 tempest-ProjectReaderTests-792343778 None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:31:34 devstack cinder-volume[86980]: INFO cinder.volume.manager [None req-bb8a73f5-a890-4868-9119-eb7c858bb514 tempest-ProjectReaderTests-792343778 None] Deleted volume successfully. Sep 28 18:31:34 devstack cinder-volume[86980]: DEBUG cinder.coordination [None req-bb8a73f5-a890-4868-9119-eb7c858bb514 tempest-ProjectReaderTests-792343778 None] Lock "cinder-4b703585-a14d-485c-b448-449b72415668-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=86980) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 18:31:43 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=25,cinder:INSERT=9,cinder:UPDATE=42,cinder:DELETE=6 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:31:44 devstack cinder-volume[86980]: DEBUG dbcounter [-] [86980] Writing DB stats cinder:SELECT=26,cinder:INSERT=10,cinder:UPDATE=39,cinder:DELETE=1 {{(pid=86980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 18:32:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:32:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 18:32:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 18:32:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729': None} {{(pid=86980) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 18:32:04 devstack cinder-volume[86980]: DEBUG cinder.volume.drivers.quobyte [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5ca793db-a494-4719-a3e6-cfba5d7a7729'] {{(pid=86980) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 18:32:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.lockutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86980) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 18:32:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 18:32:04 devstack sudo[109678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a Sep 28 18:32:04 devstack sudo[109678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 18:32:04 devstack sudo[109678]: pam_unix(sudo:session): session closed for user root Sep 28 18:32:04 devstack cinder-volume[86980]: DEBUG oslo_concurrency.processutils [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9115b1dc9ab831c5dd58838ff199042a" returned: 0 in 0.257s {{(pid=86980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 18:32:04 devstack cinder-volume[86980]: DEBUG cinder.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Notifying Schedulers of capabilities ... {{(pid=86980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 18:32:04 devstack cinder-volume[86980]: DEBUG oslo_service.periodic_task [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] Running periodic task VolumeManager._thread_info {{(pid=86980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 18:32:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread count: 28 {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 18:32:04 devstack cinder-volume[86980]: DEBUG cinder.volume.manager [None req-6139ea91-5712-412b-92e6-4ccb657e218f None None] thread info: [<_MainThread(MainThread, started 129097393381504)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}